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ABSTRACT. We study the evolution, under convex Hamiltonian flows on cotangent bundles of com- 
pact manifolds, of certain distinguished subsets of the phase space. These subsets are generalizations of 
Lagrangian graphs, we call them pseudographs. They emerge in a natural way from Fathi's weak KAM 
theory. By this method, we find various orbits which connect prescribed regions of the phase space. Our 
study is inspired by works of John Mather. As an application, we obtain the existence of diffusion in a 
large class of a priori unstable systems and provide a solution to the large gap problem. We hope that 
our method will have applications to more examples. 

Resume. Nous etudions revolution, par le flot d'un Hamiltonien convexe sur une variete compacte, 
de certains ensembles de l'espace des phases. Nous appelons pseudographes ces ensembles, qui sont des 
generalisations de graphes Lagrangiens apparaissant de maniere naturelle dans la theorie KAM faible de 
Fathi. Par cette methode, nous trouvons diverses orbites qui joignent des domaines donnes de l'espace des 
phases. Notre etude s'inspire de travaux de John Mather. Nous obtenons l'existence de diffusion dans une 
large classe de systemes a priori instables comme application de cette methode, qui permet de resoudre 
le probleme de l'ecart entre les tores invariants. Nous esperons que la methode s'appliquera a d'autres 
exemples. 
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Introduction 



In all this paper, M denotes a connected compact manifold without boundary, of dimension d, 
and TM and T*M are its tangent and cotangent bundle. We shall consider the periodic time- 
dependent Hamiltonian system generated by a function H : R x T*M — > R, and denote by 
the flow from time s to time t. 



(0.1) In order to motivate our discussion, we begin with a precise question: Given two La- 
grangian manifolds Q and Q' in the cotangent bundle, which are graphs over the base M, does 
there exist a trajectory which connects Q and Q' , or in other words does there exist times s < t 
such that the Lagrangian manifold 4>\(G) intersects Q'l 



(0.2) This question formulates some well known problems. As an example, let us suppose that 
M = T d , and identify the cotangent bundle T*T d with T d xM. d . Let us consider the Hamiltonian 
Ho = h{p), where h : W l — > R is a real function. Such Hamiltonians will be called fully integrable 
in the sequel. It is known that they leave invariant the tori T p := T d x {p}, for p e R d . As a 
consequence, the answer to the previous question is obviously negative for Q = T p and Q 1 = T p > , 
when p =/= p' . What happens for Hamiltonians H which are close to Hq? For example, it is known 
that the solar system can be described by a fully integrable Hamiltonian Ho if the interactions 
between planets are neglected. In this example, the variables p G R d encode the parameters of 
the elliptic trajectories of the planets. It is well known that these parameters would not change 
in time if the interaction between planets did not exist. Understanding for which values of p and 



p' the question (0.1) has a positive answer with Q = T p and Q' = T p /, amounts to understand 
to what extent the elliptic trajectories will deform under the influence of mutual interactions. In 
other words, it amounts to understand the secular dynamics, and the stability of the solar system. 
We will not treat these specific examples in the present papers, although they are parts of our 
motivations. See pQ and [22] for beautiful and deep examples of perturbations of fully integrable 
systems. 



(0.3) Question (0.1) is especially interesting when the Lagrangian manifolds Q and Q' have 
different Liouville classes (which corresponds to the case p ^ p' in the discussion above). In this 
case, we have a problem of non exact Lagrangian intersection, and it seems that the powerful 
tools developed to deal with exact intersections provide no interesting insight. In order to study 
this problems, we make strong assumptions on the Hamiltonian H, namely that it is convex, 



super-linear, periodically time-dependent, and complete, see details in (1.1) We will define an 
equivalence relation, called forcing relation and denoted by Hh on the set H 1 (M, R) of cohomology 
classes of Lagrangian graphs, in such a way that, if c+c', (we will say that c and d force each 



over) then the answer to question (0.1) is positive for each Lagrangian graphs Q of cohomology c 
and G' of cohomology d. The definition of this equivalence relation is one of the major ideas of 
the present paper. The key point in considering an equivalence relation is that local informations 
on the equivalence classes can be put together to obtain global information. On the other hand, 



most of the mechanisms known so far to study questions related to (0.1) the theorem of Birkhoff 
for twist maps, the geometric construction of Arnold, as well as the variational construction of 
Mather, can be expressed in this unified setting as local informations on the forcing classes (the 
classes of equivalence of the relation Hh) . Our main goal in the present paper will be to detail this 
fact and to study the local properties of the forcing classes. 



(0.4) In order to demonstrate the usefulness of our theory, let us provide an example. Proofs 
and more general statements are given in section [TT] We take M = T x T d_1 , and denote by 
(q,P) = (qi,Qs,Pi,P2) the points of T*M, where q x G T, q 2 E T^ 1 , Pl G R, p 2 G R d_1 . We 
consider the time-periodic Hamiltonian 

H(t,q,p) = Hx{t,q uPl ) + \p 2 \ 2 - V(q 2 )F(t,q) 
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and we assume that the conditions of convexity, super-linearity and completeness are satisfied. 
In addition, we assume that F : T x T d — ► M. takes positive values, and that V : T d_1 — > K 
takes positive values except at a single point, say 0, where its takes the value 0. The manifold 
T x M := {q 2 — 0,P2 — 0} is then invariant under the Hamiltonian Flow. The restricted flow is 
generated by the restricted Hamiltonian H±. Under these hypotheses, it is not hard to prove (we 
will do it) that each rotational invariant circle of the restricted dynamics H\ admits a homoclinic 
orbit. We make two additional non-degeneracy assumptions: 

(HI) The Hamiltonian H\ is generic in the sense that its irrotational invariant circles of rational 
rotation number are completely periodic. (We allow periodic circles in order to include the case 
where Hi is integrable). 

(H2) We assume a non-degeneracy hypothesis on the set of action minimizing homoclinic 
orbits to the invariant circles of H\. This hypothesis is detailed in section [TI] it should be seen as 
analogous to the classical hypothesis of transversality of the stable and unstable manifolds in the 
construction of Arnold. Although we expect in the future to prove that this condition is generic 
in some sense, we do not discuss any genericity issue here. 

Under these hypotheses, our abstract results imply the following. 

Theorem If P and P' are given real numbers, there exists a Hamiltonian trajectory (q(t),p(t)) 
and an integer t € N such that pi(0) = P and pi(t) = P' . 



(0.5) The systems described in example (0.4) are a priori unstable according to the terminology 
in use in the world of Arnold's diffusion. This is due to the presence of the distinguished invariant 
manifold {q 2 = p 2 = 0}, which in many situations is normally hyperbolic. It appears clearly in 
the fundamental paper of Arnold, pQ that the presence of such a hyperbolic invariant manifold 



intersecting Q and Q' greatly favors a positive answer to question (0.1) A priori unstable sys- 
tems have been widely studied because they appear naturally in the perturbation of completely 
integrable systems, and are easier to deal with. 

In the work of Arnold, it is also assumed that the restriction of the dynamics to the hyperbolic 
manifold is integrable, say H\ = \p\\ 2 in our example. This means that this invariant manifold 
is foliated by invariant tori which he called whiskered tori because of the presence of hyperbol- 
icity. These whiskered tori are the building blocks of Arnold's construction, so that this second 
hypothesis was very important. The main point in our application is that we do not make this 
assumption. We only assume that the restricted dynamics is generic, in a clearly specified sense. 

In the context of perturbations of fully integrable systems, the restriction of the flow to the hy- 
perbolic manifold is close to integrable, and KAM theory implies the existence of many whiskered 
tori. However, when computing precisely the various quantities that appear in Arnold's construc- 
tion, one observes that there does not exist enough tori in general. More precisely, the gap between 
tori is too big, this is the Large Gap problem, see for example [21j for a more precise explanation. 

Overcoming this problem has long been considered as a major challenge. While the classical 
approaches based on refinements on the scheme of Arnold were worked out in that direction, new 
variational methods were introduced, by John Mather in [24]. It is also worth mentioning the 
work of Bessi, [7], where the results sketched by Arnold are proved using variational methods. 
This paper contains one on the first relevant achievements of variational methods in these kind 
of questions, and it has been very influential. However, these variational methods were facing the 
same kind of difficulties as classical methods. In several special instances, the Large Gap problem 
can be bypassed because for specific reasons there exist more whiskered tori. This remark has been 
exploited to obtain many non-trivial results from Arnold's construction or variational methods. 
For example, orbits of unbounded speed where built in [8] using the scheme of Arnold. A similar 
result had previously been obtained by John Mather, [25], using variational methods, see also [19]. 
Other works exploit the same remark in different directions, see for example [6] , which elaborates 
on [7J, and many other texts. 

Solutions to the Large Gap problem have recently been given by Delshams, de la Llave and 
Seara, see [13], and by Treschev, see [29] using elaborations on Arnold's method. The details in 
these works are far from simple. Cheng and Yan have also proposed a solution using elaborations 
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on the variational methods initiated by Mather, see [S], and [TUj, as well as Z. Xia, see [3D] and 
[31 j . Compared to these papers, the spirit of our work is different. We present mechanisms of 
instability which are more general, but more abstract. We present some examples for illustration, 
and in order to give the reader a hint of how the abstract mechanisms can be used, but we do not 
try at that point to describe the more general applications. Neither do we discusss the genericity 
of our hypotheses. 

The influence of John Mather's published and unpublished works on the developpement of 
variational approaches could not be overestimated. He has announced in |26j very deep results 
on the perturbation of fully integrable systems in dimension 2, and given indications on proofs in 
various talks and lectures. I hope that the tools developed in the present paper will contribute to 
clarify and extend these results. 

(0.6) Let us now enter more precisely into matter. Given a Lipschitz function u : M — ► M and 
a closed smooth form 77 on M, we consider the subset G v ,u of T*M defined by 

Gij,u = {( x ,Vx + du x ),x £ M such that du x exists}. 

We call the subset Q C T*M an overlapping pseudograph if there exists a closed smooth form 77 
and a semi-concave function u such that Q = G^,u- See Appendix [Al for the definition of semi- 
concave functions. Each pseudograph Q has a well defined cohomology c(Q) S H 1 (M, R), see 



(2.2) which is just the De Rham cohomology [77] of the closed form appearing in the definition of 
Q. We denote by P the set of overlapping pseudographs. If M — T is a circle, then overlapping 
pseudographs are graphs of functions which have only discontinuities with downward jumps, or in 
other words functions which can be locally written as the sum of a continuous and a decreasing 
function. Such sets were introduced in |20j . where they are used in very elegant proofs of many 
known properties of Twist maps. In higher dimension, overlapping pseudographs naturally arise 
from Fathi's approach of Mather theory. 

(0.7) We define the forcing relation Hh on ff 1 (M, K) as follows: We say that c and d force 
each other (in short cHhc') if there exists an integer TV G N such that, for each pseudograph Q of 
cohomology c (resp. c'), there exists a pseudograph Q 1 of cohomology c' (resp. c) such that 



G'c |J 4>UG), 



where Q 1 is the closure of Q' in T*M. This definition is certainly one of the most important novelties 
in the present paper. Note that, if cHhc', if Q is a Lagrangian graph of cohomology c, and if Q' is a 
Lagrangian graph of cohomology c', then there exists a Hamiltonian orbit which connects Q and Q' . 
As a consequence, understanding the equivalence classes of this relation is a useful tool in the study 
of our motivating question. Our main goal in the present paper will be to find sufficient conditions 
for two classes to be equivalent. It turns out that, although the definition seems very strong, the 
existence of non-trivial forcing classes can be proved in many interesting situations, as example 



(0.4) In fact, many of the known constructions of orbits connecting prescribed regions of phase 
space (Birkhoff's theory of twist maps, Mather's variational construction of connecting orbits, 
Arnold's geometric construction of diffusion) can be adapted to this framework, and rephrased as 
the existence of large forcing classes. 



(0.8) We shall define, following Fathi, an operator $ : P — > P in (2.5)[ with the following 
fundamental properties: 

where 4> := </>q is the time-one map of the Hamiltonian flow, and c($>(G)) = c(Q). Fathi's weak 
KAM theorem, [TB] states that, for each c G H 1 (M, M), the operator $ has fixed points of coho- 
mology c. We call V c the set of these fixed points, see section [3J for details. The fixed points Q 
satisfy 

G c 4>{Q), 
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and give rise to compact invariant sets 

W) :=fl^)- 

This provides a new way, due to Albert Fathi, to define various invariant sets previously introduced 
by Mather in [23] and [24] . 

(0.9) More precisely, to each cohomology c £ H 1 (M, R) we associate the non-empty compact 
invariant sets 

7W(c) cA(c) cAf(c), 

where 

i(c) := p| 1(g) andAA(c) := |J 1(g), 

eev c aev c 

are respectively called the Aubry set and the Mane set, and A4(c), called the Mather set, is the 
union of the supports of the invariant measures of the action of <fi on A(c) (or equivalently on 



A/"(c)), see (3.5) for more details. A standing notation will be to denote by X subsets of T*M, 



and by X their projection on M. 



Beyond answering question (0.1) understanding the forcing relation Hh has many dynamical 
consequences: 

(0.10) Proposition. 

(i) Let Q and g' be two Lagrangian graphs of cohomologies c and c' . If c-\rc' then there exists 
a time t£N such that </>g({?) intersects g' . 

(ii) If cHhc', there exists a heteroclinic trajectory of the Hamiltonian flow between A(c) and 
A(c>). 

(Hi) Let Ci,i £ Z, be a sequence of cohomology classes all of which force the others. Fix, for each 
i a neighborhood Ui of A4(ci) in T*M. There exists a trajectory of the Hamiltonian flow 
which visits in turn all the sets Ui . In addition, if the sequence stabilizes to c— on the left, 
or (and) to c+ on the right, the trajectory can be assumed negatively asymptotic to A(c— ) 
or (and) positively asymptotic to A(c+). 

The proof is given in section [5] Let us now state our main results which, as announced above, 
describe the local structure of the forcing classes. 

(0.11) For each Q £ V, we define the subspace R(Q) of H 1 (M,M.) as the set of cohomology 
classes of smooth closed one- forms whose support is disjoint from 1(g)- For each cohomology 
class c £ H 1 (M, R), we define the subspace R(c) as 

R(c) = p| R(g) C H\M,R). 

The following Theorem reformulates and extends results of John Mather, see [53] and also [5] and 
[9]. It is proved in section [8] 

Theorem. For each cq £ H 1 (M,M), there exists a positive e such that the following holds: Each 
class c £ H 1 (M,R) such that c — cq £ R(cq) and \\c — Co 1 1 ^ e satisfies co+c. 

In order to illustrate this result, it is useful to consider the case of twist maps M = T. In this 
case, the reader should check that R(c) = R or 0, and that R(c) = if and only if there exists a 
rotational invariant circle of cohomology c, see (few) more details in section [TUJ The above result 
then roughly says that rotational invariant circles are the only obstructions to the evolution of 
action variables, and recovers the theory of Birkhoff. We will explained in section [TT] how this 



result allows to overcome the possible absence of invariant circles in example (0.4) 
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(0.12) There is a natural partition of the Aubry set A(c) into compact invariant subsets iS called 
the static classes, see section^ A generalized version of the following theorem is proved in section 
1 

Theorem. Assume that there exists only finitely many static classes in A{c), and that the 
set M{c) — A(c) is not empty and contains finitely many orbits. Then the cohomology c is in the 
interior of its forcing class. 

This result may be seen as a reinterpretation in our langage of the geometric construction 
of Arnold. We explain in section [11] how it allows to take into account the possible presence of 



invariant circles of Hi in example (0.4) We mention that, for a generic Lagrangian, all the Aubry 



sets A(c), c 6 H 1 (M, R) have finitely many static classes, see [3] 

(0.13) Let us now present the content of the paper. The whole paper heavily relies on the notion 
of semi-concave function and of equi-semi-concave sets of functions. These notions are presented 
in Appendix[AJ In AppendixfB] we prove some background results, essentially due to Mather and 
Fathi, about the properties of the Action. 

Mather-Fathi Theory. 
This first part is a survey of the theory of Mather, Mane and Fathi of globally minimizing orbits, 
from a point of view very close to the one of Fathi. This survey is presented not only for the 
convenience of the reader, but also because we need various variations on existing results, and 
also we need to recast the theory in our framework. In section [TJ we present the context, detail 
the standing hypotheses, and recall some known results of the calculus of variations which will 
be of constant use (proofs are given in Appendix [B|) . Pseudographs are defined and their basic 
properties studied in Section [2] In Section [3] we use these pseudographs to present Fathi's point 
of view on Aubry-Mather theory. The theory is continued in section [4] where we explain Mane's 
decomposition in static classes of the Aubry set, and the construction of homoclinic orbits, due to 
Fathi [Tg] , Contreras and Paternain [TT], (see also [5]) which will play a central role in section [5] 

Abstract mechanism. 

This part contains the main novelties of our paper. In section [5] we define the forcing relation Hh 
and explain how various orbits can be built once this relation is understood. We prove Proposition 



(0.10) We then introduce and study evolution operators on P, which are elaborations around the 
Lax-Oleinik operator, in section [SJ Section [7] is a parenthesis where we study the action of taking 
finite Galois covering, which will be essential for applications. The idea of taking finite Galois 



coverings comes from Fathi [18]. In section[8] we prove and comment Theorem (0.11) In section 



|9]we study the case where there exist only finitely many static classes. We generalize and prove 



Theorem (0.12) 



Applications. 

In this short part, we detail some straightforward applications of the results obtained before. We 
hope that it is possible to obtain much more applications by applying our results with Hamiltonian 
methods such as normal form theory, but this aspect is not discussed here. Section [10] briefly 



mentions the application to twist maps. Section [TT] details (0.4) above 



Mather-Fathi Theory 

This part is an overview of the theory of Mather, Mane and Fathi of globally minimizing orbits, 
which is oriented towards our future needs. We introduce our main objects. Our point of view is 
close to the one of Fathi. Most of the material exposed here is a small deformation of results in 

m, m\, or m- 

1 Calculus of variations 

(1.1) We shall consider C 2 Hamiltonian functions H : R x T*M — > R. We will denote by 
P = (x,p) the points of T*M. The Cotangent bundle is endowed with its standard symplectic 
structure. We denote by X(t,P) or X(t,x,p) the Hamiltonian vector-field of H, which is a time- 
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dependent vector-field on T*M. We fix once and for all a Riemannian metric g on M, and use it to 
define norms of tangent vectors and tangent covectors of M. We will denote this norm indifferently 
by \P\ or by \p\ when P = (x,p) 6 T*M . We assume the following standard set of hypotheses. 

1. Periodicity. H(t +l,P) = H(t, P) for each (t, P)eKx T*M. 

2. Completeness. The Hamiltonian vector-field X generates a complete flow of diffcomor- 
phisms on T*M. We denote by </>* : T*M — > T*M the flow from time s to time t, and by 
<j> the flow cpQ. 

3. Convexity. For each (t, x) 6 M x M, the function p — ► H(t,x,p) is convex on T*M, 
with positive definite Hessian. Shortly, d^H > 0. 

4. Superlinearity. For each (t, x) e R x M, the function p i — > H(t,x,p) is super-linear, 
which means that limi p i >OQ H(t,x,p)/\p\ = oo. 

(1.2) We associate to the Hamiltonian H a Lagrangian function L:Ix TM — > R defined by 

L(t,x,v) — sup p(v) — H(t,x,p). 

p£T* M 

The fiberwise differential <9 p -ff of can be seen as a mapping 

<9 p ff : R x T*M — »lx TM, 
this mapping is a diffeomorphism, whose inverse is given by 

d v L : R x TM — > R x T*M. 

We have the relations L(t, x, v) = d v L(t, x, v)(v)—H(t, x, d v L(t, x, v j) and H(t, x,p) = d p H(t, x,p)(p) — 
L(t, x, d p H(t, X,p)). The Lagrangian L satisfies the following properties, which follow from the 
analogous properties of H: 

1. Periodicity. L(t + 1, V) = L(t, V) for each (t, V) 6 R x TM. 

2. Convexity. For each (t, x) e R x M, the function w i — > L(i, v) is a convex function on 
T X M, with positive definite Hessian. Shortly, d%L > 0. 

3. Superlinearity. For each (t, x) e R x M, the function v i — > L(t,x,v) is super-linear on 
T X M. 

See Appendix |5] for comments related to these hypotheses. The hypotheses listed above are very 
suitable to use the calculus of variations. 

(1.3) Let us fix two times s > t in R and two points x and y in M. Let E(t, x; s,y) be the set 
of absolutely continuous curves 7 : [t, s] — ► M such that 7(4) = x and 7(s) = y. As usual, we 
define the action of the curve 7 as ^(7) = J L(a,j(a),j(a)) da. It is known that, for each C, 
the set of curves 7 in £(t, s, y) which satisfy ^(7) ^ C is compact for the topology of uniform 
convergence. As a consequence, there exist curves minimizing the action. Let us define the value 

A(t,x;s,y)= min / L(a, 7(0"), 7(0-)) da, 

and let £ m (t, x; s, y) be the set of curves in E reaching the above minimum. The set E m (i, x; s, y) 
is not empty, and it is compact for the topology of uniform convergence. Each curve j(a) € E TO 
is C 2 and satisfies the Euler-Lagrange equations. Setting 

p(a) = 9 t ,L(cr,7(cr),7(cr)), 

which is equivalent to 

7(ct) = d p H{a,j{a),p(a)), 

these equations are 

p(a) = d x L(a,j(a), A /{a)) = -d x H(a,^{a),p{a)) 
Hence the curve (7(c), p(a)) is a trajectory of the Hamiltonian flow. 
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(1.4) For each minimizing curve 7 G S m (t, n; s, y), we have 

-p(t) = -8 v L(t, x, 7(t)) G #A(t, x; s, y), 

where <9+A(i, x; s, y) denotes the set of proximal super-differentials of q 
q = x, see Appendix A. We also have 

p(s) = d v L(s, y, j(s)) G d+A(t, x; s, y). 



A(t, q; s, y) at point 



For each t' > t, the set of functions (x, y) 1 — > A(t, x; s, y), s ^ t' is equi-semi-concave on M x M, 
hence equi-Lipschitz, see Appendix A. In addition, the three following properties are equivalent: 

(i) The set £ m (t, x; s, y) contains only one point. 

(ii) The function A(t, .; s,y) is differentiable at x. 

(Hi) The function A(t, x; s, .) is differentiable at y. 

If these equivalent properties hold, and if 7(c) is the unique curve of £ m (t, x\ s, y), then setting 
p(cr) = d v L(a,y,j(a)) 1 we have 

p(t) = -d x A(t, x; s, y) and p(s) = 5 y v4(t, x; s, $/). 

(1.5) Let 77 be a smooth one-form. We will see the form 77 sometimes as a section of the 
cotangent bundle rj : M — > T*M and sometimes as a fiberwise linear function on the tangent 
bundle rj : TM — > M. If the form rj is closed then the diffeomorphism (f> v : (x,p) 1 — > [x,p + r] x ) 
of T*M is symplectic. The Hamiltonian 

H n (t,x,p) = H o <j> v (t, x,p) = H(t,x,p + r] x ) 

satisfies our hypotheses. The associated Lagrangian is (L — rf)(t,x,v) — L(t,x,v) ~ rj x (v), where 
77 is considered as a function on TM. The following diagram commutes for each t. 

T*M 



TM 





T*M 



(1.6) We will also consider the modified action 



A n (t, x;s,y) = inf / L(a, 7(a), 7(0-)) - r] l{a) (7(d)) da, 

7e£(t,iE;s,3/) J t 



which of course satisfies all the properties of (1.4) with the modified expressions 

rj x -p(t) G d+A v (t,x; s,y) and p(s) - rj y G d+A v (t,x; s,y) 

when (7(c), p(cr)) : [a, t] — > T*M is the Hamiltonian trajectory associated to a curve 7 G 
E(t, x; s, y) minimizing A v . 

(1.7) Let il be the set of closed smooth forms on M. It is useful to fix once and for all a linear 
section S of the projection £1 — > H 1 (M, K). In other words, 5 is a linear mapping from H X {M, R) 
to such that [5(c)] = c. We shall abuse notations and denote by c the form 5(c), in such a 
way that the symbol c denotes either a cohomology class or a standard form representing this 
cohomology class. 
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(1.8) The following consequence of Appendix 151 will be useful. See appendix [Al for the definition 
of equi-semi-concave. 

Proposition. If C is a bounded subset of H X {M, R) ; and e is a positive number, the functions 
A c {s, .; t, .), c 6 C,t ^ s + e are equi-semi-concave on M x M. 

2 Overlapping pseudographs. 

We present the main objects, overlapping pseudographs, and study some basic properties. The 
relevance of semi-concave functions to this kind of problems was noticed by Albert Fathi. 

(2.1) Given a Lipschitz function u : M — > R and a smooth form rj on M, we define the subset 
G VtU of T*M by 

Gi),u = {(%, Vx + du x ),x € M such that du x exists}. 

We call the subset Q c T*M an overlapping pseudograph if there exists a smooth form rj and a 
semi-concave function u such that £7 = . See Appendix [X] for the definition of semi-concave 
functions. We shall denote by P the set of overlapping pseudographs. Given a pseudograph Q, 
and a subset U C M, we will denote by G\u the set Qvu '■= Q H 7r^ 1 (/7). 

(2.2) It is not hard to see that if an overlapping pseudograph Q is represented in two ways 
as Q-q.u and Qp,, v , then the closed forms rj and /i have the same cohomology in H 1 (M, R). As a 
consequence, it is possible to associate to each pseudograph Q a cohomology c(C/), in such a way 
that 

c(0 n , u ) = [rj\. 

We will denote by P c the set of overlapping pseudographs of cohomology c. If Q is an overlapping 
pseudograph of cohomology c, then Q can be represented in the form Q = Q C ui where c is the 



standard form defined in (1.7) The function u is then uniquely defined up to an additive constant. 
As a consequence, denoting by S the set of semi-concave functions on M, and by P the set of 
overlapping pseudographs, we have the identification 

P = ff 1 (Af,R) x S/R. 

This identification endows P with the structure of a real vector space. Let us endow the factor 
S/R with the norm \u\ = (maxii — minu)/2, which is the norm induced from the uniform norm 
on §. More precisely, we have |u| = min„ ||w||oo, where the minimum is taken on functions v which 
represent the class u. We put on P the norm 

\\S c ,u\\ = \c\ + (maxu - minu)/2 |c| + ||u||oo- 

The set P is now a normed vector space. It is also useful to define, for each subset U C M, the 
number 

||&,u||i7 : = |c| + (supu - inf u)/2. 

u u 

We define in the same way the set P of anti- overlapping pseudographs Q, which are the sets 
with rj a smooth form and m£§. This set is similarly a normed vector space. 

(2.3) Lemma. Let Q be an overlapping pseudograph, and Q be an anti- overlapping pseudo- 
graph. If G and have the same cohomology, then they have nonempty intersection. 

Proof. Let us write g = g v , u and — g r) - v . Let x € M be a point minimizing the continuous 
function u + v. Since they are semi-concave, both u and v are differentiable at x, and du x = —dv x . 
It follows that the point (x, rj x + du x ) — (x, r\ x — dv x ) belongs both to g and to Q. rj 
It is natural to introduce the following definition. 
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Definition. Let Q be an overlapping pseudograph, and Q be an anti- overlapping pseudograph. 
If Q and Q have the same cohomology c, write them Q — Q c . u and Q — Q c .%. We denote by 

GAG CM 

the set of points of minimum of the difference u — u, and by QAQ C Q l~l Q the set 

gKg : = g n ir-\g a g) = g n ^{g a g) = Q n g n ^{g a g) c t*m. 

This set is compact, not empty, and it is a Lipschitz graph over its projection g A Q. 



Proof. We have proved already that the set g A g is not empty. It follows from Appendix (A.. 



that both u and u are differentiable on g A g, and that the map x i — ► du x — —du x is Lipschitz on 
this set. This makes the definition meaningful. The set gKg is compact because it is the image 
of the compact set g A Q by a Lipschitz map. rj 



(2.4) Let us fix a closed form 77. We define the associated Lax-Oleinik mapping on C (M, R) 
by the expression 

T v u{x) = min (u(q) + A v (0, q; 1, x)) 

Let us recall some important properties of the Lax-Oleinik mapping, which are all direct con- 
sequences of the properties of the function A given in (1.4) For each form rj, The functions 
T v u,u G C(M, R) are equi-semi-concave, see Appendix IAI The mapping T v is a contraction: 

\\T v u - Tj^Hoo ||u - vWao. 

To finish, the mapping T v is non-decreasing, and it satisfies TV, (a + u) — a + T n (u) for all real a. 

(2.5) There exists a unique mapping $ : P — > P such that 

for all smooth form 77 and all semi-concave function u. We have 

c(*(s)) = c(g). 



The mapping $ is continuous (see (6.2) for the proof of a more general result). For each cohomology 
c, the image $(P C ) is a relatively compact subset of P c , as follows directly from the properties 
of the Lax-Oleinik transformation recalled above. Note that this implies the existence of a fixed 
point of $ in each P c , this is how Fathi proved the existence of fixed points. See (3.2) for another 
proof. We call V c the set of these fixed points, and V = U C V C . We also define the sets 

O := f)W(Pj= p| $"(P) 

nGN TiSN 

and O c := OnP c . Note that O c is compact and invariant under and that V C O. A pseudograph 
g G P c belongs to O if and only if there exists a sequence g n G P, n G Z of pseudographs such that 
§ m ~ n (g n ) = Qm for all m ^ n, and such that £0 = g. Note that we then have g n G O c for each 

nez. 

(2.6) The mapping <I> satisfies 



${G) C <j>{G). 

This inclusion is a consequence of the following Proposition, which will be central througrought 
the paper. 
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(2.7) Proposition Let us fix a pseudograph Q, hU G P. an open set U C M and two times 
s < t. Let us set 

v(x) = mmu(q) + A,Js, q; t, x), 

where U is the closure ofU. Let V C M be an open set and let N C M be the set of points where 
the minimum is reached in the definition of v(x) for some x 6 V. Lf N C U , then 

Q V .v\V C ^(GtjMn) 

and G V , U \N * s a Lipschitz graph above N . Ln other words, the function u is differentiable at each 
point of N , and the mapping q i — ► du q is Lipschitz on N . 

Addendum. In addition, the Hamiltonian trajectories (x(o~), p(o~)) : [s,t] — > T*M which 
terminate in G v ,v\v, i- e. such that (x(t),p(t)) € G v ,v\v satisfy 

v(x(t)) = u{x(s)) + / L(a,x(a),x(a)) -r] x ^(x(a))da 

J s 

= u(x(s)) + A v (s, x(s); t, x(t))) = minw(x) + A„(s, x; t, x(t))). 

xeu 



Proof. Let us fix a point x G V , and consider a point q E N minimizing in the expression of v(x). 
Since q is a point of local minimum of the function u + A v (s, ., t, x), the semi-concave functions u 
and A v (s, .,t,x) are differentiable at q and satisfy du q + d q A n {s,q,t,x) = 0. In view of (1.4) we 
have d q A n (s, q, t, x) — rj q — p{s), where 

(x(a),p(a)) = {x{a),d v L{a,x{cj),x{a))) : [s,t] — ► T*M 

is the Hamiltonian trajectory associated to the unique minimizing curve x(a) G S OT (s, q, t, x). 
Uniqueness follows from the differentiability of A Jj (s, -,t,x) at q, see (1.4) We have 

(x(s),p(s)) = {q,du q + n q ) C G v ,u 

and therefore 

(x{t),p(t)) =<f> t a (q,du q + tj q ) etf s (G n , u \N)- 

Since the functions A v (s, .,t, x), x G M are equi-semi-concave, they are all i^-semi-concave for 
some K. It follows that the function u has a if-sub-differential at each point of N, and therefore 
at each point of N. We conclude using (A. 7) that the function u is differentiable on N, and that 
the map q i — ► du q is Lipschitz on A. As a consequence, we have 

Gri,u\N = G v ,u\N, 



and this set is a Lipshitz graph over N. Still exploiting (1.4) we get that the function A^s, q, t, .) 
is differentiable at x, and satisfies d x A ri (s, q,t, x) = p(t) — r\ x . Noticing that the function v — 
A ri (s, q, t, .) has a local maximum at x, we conclude that dv x = pit) — r\ x if v is differentiable at x, 
and therefore that 

(x, i] x +dv x ) = (x(t),p(t)) G </>*(0, ):M |at) 

for each point of differentiability x G V of v. In other words, we have the inclusion G v , v \v C 
^(^j7,«|jv) , hence 

G v ,v\V C 4i(Gr,,u\N) = 4i(0 n ,u\N) ■ 

□ 
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(2.8) Let Q = Q c u be a fixed point of $. And let n < to be two relative integers. Following 
Fathi, we say that a curve x(t) : [n, to] — > M is calibrated by Q if 



u{x{n)) + / L(t,x(t),x(t))-c x{t) (x(t))dt = T?- m u{x(m)), 

J n 

note, since u is a fixed point of $, that T"~ m M = it+ (m— n)a(c), where a(c) is a constant (which, 



is 



as we will see below depends on c but not on it). A consequence of the addendum in (2.7) 
that the curve x(t) is calibrated by Q if the curve (x(t),p(t) = d v L(t, x(t), i(t))) is a Hamiltonian 
trajectory satisfying (x(m),p(m)) G Q. Conversely, if x(t) is calibrated by Q, then (x(k),p(k)) £ 5 
for each integer k 6 [n, m[. 

(2.9) The following Corollary is the reason why we have called the elements of P overlapping. 
Corollary All overlapping pseudographs Q £ P satisfy n o <j)(Q) = M. 



PROOF. We have $(£) C </>(£), and 7r($(£)) is dense in M, so that tt($((?)) = M. Q 



(2.10) It is useful, still following Fathi, to define "dual" concepts. We define the dual Lax- 
Oleinik operator associated to a closed form n by the expression 

f v u(x) = max (u(q) - A v (0,x; l,q)), u £ C(M,R) 

and we associate to this operator a mapping <3E> : P — > P by the expression <b(G c ,-u) — G c f t u \ G 
P. We have 

HQ) c <jr\G) 

if Q £ P. We denote by V the set of fixed points of <t. Let Q = Gc,-u be a fixed point of <&, and 
let n < to be two relative integers. We say that a curve x(t) : [n, to] — > M is calibrated by Q if 

u(x(m)) - / L(t, x(t), x(t)) - c x(t) (x(t))dt = f™- n u{x(n)). 

J n 

(2.11) It is useful to collect a few remarks. We have 

T c T c u ^ u 

for all continuous functions u. Writing f ™ +1 T c " +1 w =T?f c T c T?u, we observe that f^T'^u is a 
non-increasing sequence of functions. Conversely, T™T™u is non-decreasing for each continuous 
function u. 

3 Aubry-Mather sets 

We use the overlapping pseudographs to recover various invariant sets introduced by Mather, 
and to study their major properties. We also establish the equivalence between the different 
definitions of the same sets given in the literature. Most of the section follows Fathi [15], with 
some minor variations. 

(3.1) Proposition There exists a function a : H 1 (M,R) — > R such that, for each continuous 
function u and each form 77 of cohomology c, the sequence T™u(x) + na(c),n ^ 1 of continuous 
functions is equi-bounded and equi-Lipschitz. The function c 1 — > a{c) is convex and super-linear. 
More precisely, there exists a constant K(c), which does not depend on the continuous function u, 
such that 

minu — K (c) ^ T™u(x) + na(c) ^ maxu + K{c). 
for each n £ N and x £ M . 
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Proof. Let us fix a cohomology class c, and define the sequences 

M„(c) := maxT"(0)(V) and m„(c) := min T c n (0)(x), 

where is the zero function on M. Since the functions T"(0),n 1, are equi-semi-concave, see 
Appendix [XJ there exists a constant if such that 

sC M n (c)-m n (c) ^ if 

for n ^ 1. We claim that M n+m (c) ^ M n {c) + M m (c). This follows from the inequalities 

T c m+ "(0)(x) = T c m (T c "(0))(x) ^ T c m (Af„(c))(x) < M n (c) + T™(0)(x). 

Hence by a classical result on subadditive sequences, we have lim M n (c)/n = inf M n {c)/n. We de- 
note by — a(c) this limit. In the same way, the sequence —m n (c) is subadditive, hence m n (c)/n — > 
sup m n (c)/n. This limit is also — a(c) because ^ M n (c)—m n {c) ^ if. Note that mi(c) ^ — a(c) ^ 
Mi(c), so that a(c) is indeed a finite number. We have, for all n ^ 1, 

—if — na(c) ^ m„(c) ^ -na(c) ^ M n (c) $5 if — na(c). 

Now far all u £ C(M, E), n £ N and a; £ M, we have 

minw — if ^ minu + m„(c) + nafc) ^ T™u(x) + na(c) ^ maxu + Ai„(c) + na(c) ^ maxw + if, 
M M M M 

and we obtain the first conclusion of the Proposition. The explicit definition of the value m n (c) is 



m„(c) = min / L(s,j(s), A f(s))-c lis) ( A f(s))ds. 

As a consequence, the function c i — > m„(c) is concave, as a minimum of linear functions. Hence 
each of the functions c i — ► m n (c)/n is concave, so that the limit — a(c) is concave, and the function 
a(c) is convex. Since a(c) ^ if — mi(c), it is enough to prove that —mi is super-linear as a function 
of c in order to prove that a is. For each homology class h £ Hi(M, Z), let 7?,, : [0, 1] — > Ai be a 
closed curve representing this homology class. We have 

-toi(c) ^ c(h) - / L(s,j h (s),j h (s))ds. 
Jo 

This implies that —mi, hence a, is super-linear. Indeed, in order that a function / : l n — > K is 
super-linear, it is enough that there exists, for each y £ Z™, a value a a such that /(x) ^ y ■ x — a y 
for each a;. rj 



(3.2) Proposition. Let its fix a closed form r\ and a continuous function u. Let us set 

v := lim inf +na([?7])), 

then v is a fixed point of T v + a hence Q VjV is a fixed point of $. 

Proof. The one- form 77 is fixed once and for all in this proof, we omit the subscript 77, and 
denote by a the number a([?7]). Let us first prove that Tv + a ^ v. In order to do so, we fix 
x G M and consider an increasing sequence of integers such that T Uk u(x) + n^a — > v(x). Let 
qk be a point such that T nk u(x) — T nk ~ 1 u(qk) + A(0, q^; 1, x) or equivalently, T nk u(x) + n^a = 
T rik ~ 1 u(qk) + (rife — l)a + a + A(0, q^; 1, x). We can suppose that the sequence q^ has a limit q. 
Taking the lim inf in the equality above gives 

v{x) ^ v(q) + A(0, q,l,x)+a^ Tv(x) + a 

where we have used the equi-continuity of the functions T n u, n £ N. 

In order to prove that Tv + a ^ v, just notice that T n u{x) ^ T n ~ 1 u(q) + A(0, q; 1, x) for each 
q and x, or equivalently that T n u(x) + na ^ T n ~ 1 u(q) + (n — l)a + A(0, q; 1, x) + a and take the 
liminf. n 
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(3.3) Lemma Let us fix a closed form rj of cohomology c. Let M C C(M, K) be a family of 
fixed points of the Lax-Oleinik operator T n + a(c). Assume that the infimum v(x) = inf„ e M u(x) 
is finite for one (and then each) x G M. Then the function v is a fixed point of T n + a(c). 

Proof. For all functions mgM and all points x and y in M, we have u{x) ^ u(y) + A v (0, y; 1, x) + 
a(c). It follows that v(x) ^ v(y) + ^(0, y; 1, x) + ar(c), so that 

u(x) «S inf + A v (0, y; 1, a:)) + o(c). 

In order to prove the other inequality, let us fix e > 0, take a function u G M such that u(x) ^ 
u(x) + e, and consider a point y £ M such that it(x) = w(y) + -4^(0, y\ 1, x) + a(c). We obtain 

u(x) ^ w(x) - e > + A v (0, y; 1, x) + a(c) - e > v(y) + A,,(0, y; 1, x) + a(c) - e. 

As a consequence, we have v(x) ^ T v v(y)a(c) — e, and, since this holds for all e > 0, the desired 
inequality follows. rj 



(3.4) Fixed points of the Lax-Oleinik operator T c + a(c) will be called weak KAM solutions, 
following Fathi. We denote by V C P the set of fixed points of $, and V c C P c the set of fixed 
points of $ of cohomology c. Sometimes, we will also denote by Vc the set of fixed points of $ 
whose cohomology belongs to the subset C C H 1 (M, R). The set V c is non-empty for each c. If 
G G V, then it follows from (2.6) that 

gc<t>(g). 

It is then natural to define the set 

1(G) = p| 

which is a non-empty compact ^-invariant subset of T*M. We also define 

1(G) = n(l(G)) C M. 
More generally, for each Q G P, we define the set 

1(g) ■.= p| d>- n W(g))- 



Since "($"(£/)), is a non-increasing sequence of compact sets, the set 1(G) is compact and not 
empty for each Q G P. 

(3.5) For each Q G V, we define the set M.(G) as the union of the supports of invariant measures 
of If G G V and (/' e¥ have the same cohomology c, then it is known that 

M(G) cl(G') 

hence M(G) = -M(G')- As a consequence, the set Ai, usually called the Mather set, depends only 
on the cohomology c. It will be denoted by 

Af(c), 

and as usual, we will denote by Ai(c) the projection tt(A4(c)). We also define the Aubry set in a 
usual way by 

A(c) = p| 1(G) 
and A(c) — n(A(c)). The Mane set is defined by 

a7( c ) = |J 

eev c 
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and N(c) — tt(M(c)). A bigger set will be useful in some occasions, defined by 

£( C ) = |j i(a), 

geo c 



where O c is as defined in (2.5) As an intersection of Lipschitz graphs, the Aubry set A(c) is a 
Lipschitz graph over A{c). Note however that the Mane set is not a Graph in general. The sets 

M(c) C A(c) C M(c) C £(c) 

are compact and invariant under <j). The compactness of M(c) and £ (c) is mentioned here for 
completeness, it will be proved later in this section, in (3.12) and (3.13) below. These Lemma also 
prove that the Mane set is indeed the set of orbits called c-minimizing by Mather and semi-static 
by Mane, and that the set £ is the set of minimizing orbits, called Q in [3]. 

(3.6) It is possible to associate to each dual fixed point Q £ V the invariant set 



and its projection 1(G) on M. The following is due to Fathi, [17] , 

Proposition. Let us fix a cohomology c, and consider pseudographs Q £ V c and Q £ V c . The 
set QKQ is non-empty, compact and invariant by </>. In addition, this set intersects the Aubry set 
A(c), and satisfies 

GAG c 1(G) ni(G) 

so that 

Q AG ci(5) nl(a). 

Furthermore, for each pseudograph Q £ V C; there exists a pseudograph Q £ V c such that 

Gt\G=T(G) =x(a). 

In a symmetric way, for each pseudograph G £ V c , there exists a pseudograph G £ V c swc/i i/iat 
£/ms relation holds. As a conseguence, we have 



A(c) = p| f(a) - f) f(a) 



and 



aev c 

A7( C ) = |J 1(G) 

eev c 



U 

aeVc 



Proof. We have already proved that the set GT\G is compact and not empty, see (2.3) Let us 
prove that it is invariant. In order to do so, we consider a weak KAM solution u and a dual weak 
KAM solution ii such that G — Gc,u and G = Gc.u- Let (x(t),p(t)) : R — > T*M be an orbit of the 
Hamiltonian flow, such that (x(0),p(0)) £ G7\G- Clearly, both u and u are differentiable at x(0), 



and p(0) 



c(0) 



du x ($y For each m ^ n in N, we have 

u(a;(n)) = min u(x) — A c (m, x, n, x(n)) + (n — m)a(c) 

^ u(x(m)) + A c (m, x(m), n, x(n)) + (n — m)a(c). 



On the other hand, we have (x(0),p(0)) £ G hence, in view of (2.7) 



u(x(n)) = u(x(m)) + A c (m, x(m), n, x(n)) + (n — m)a(c). 
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As a consequence, the sequence n i — ► (u — u)(x(n)) is non-increasing on N. Since its initial value 
(u — ii)(x(0)) has been chosen to be a minimum of the function u — u, the sequence must be 
constant, so that x(n) is a point of Q A Q for each n 0. A symmetric argument shows that 
this is also true for n 0. In addition, we obtain that the inequality u(x(n)) ^ u(x(m)) + 
A c (m, x(m), n, x(n)) + (n — m)a(c) is in fact an equality for $J m ^ n. Since this formula is true 



in view of (2.7) for m ^ n $J in Z, we obtain that, for all m n in Z, 

u(x(n)) = u(x(m)) + A c (m, x(m), n, x(n)) + (n — rn)a(c). 



In other words, the curve x(t) is calibrated by Q and by G, see (2.8) This implies that (x(n),p(n)) G 
<7 fl £ for each ngZ, and, since x(n) e 5 A§, we get (x(n),p(n)) 6 £/A£- This proves that C/A0 
is invariant by <j) and contained in and in 1(G)- 

Every compact invariant set of 1(G) carries an invariant measure. As a consequence, every 
compact invariant set of 2(G) intersects the Mather set Ai(c), see (3.5) Since M.(c) C A(c), 
the set G/\G, which is a compact and invariant subset of 1(G), intersects A(c). Let us now 
fix the Pseudograph Gc.u & V c , and prove the existence of a pseudograph G £ V c such that 
G A G — 1(G) = 1(G)- In order to do so, we set 



u := lim T™u — na(c) 



lim T"T>. 



It follows from |(2. 11)| and |(3. 1)| that the limit exists and that u < u. Let : M — ► T*M 

be a Hamiltonian orbit satisfying (x(0),p(0)) e 1(G)- The orbit is then calibrated by G, see 
(2.8) so that the relation 



u(x(n)) — u(x(m)) = A c (m, x(m); n, x(n)) + (n — m)a(c) 

holds for all m ^ n in Z. It is clear from this relation that, for each n € N, 

f?u(x(0)) ^ u(x(n)) - A c (0, x(0); n, x(n)) = u(x(0)) + na(c), 

So that T™u(x(0)) — na(c) = u(x(0)), hence u = u on 1(G)- As a consequence, the set of points 
minimizing u — u contains 1(G)- Since we have already proved that this set is contained in 1(G), 
we can conclude, as desired, that 

Gc,u A Gc.u — 1(G)- 
Setting v! = limT"w + na(c) = limT™T"£t, the same proof gives that 

Gc,u' A Gc.u — 1(Gc,u)- 

We claim that u' = u, so that we have proved 

Gc.u A Gc.u. — 1(Gc,u) = 1(Gc,u)- 

In order to prove that u' — u, we first recall that u ^ u, so that T™it + na(c) si T™u + m(c) = it, 
and u' ^ it. On the other hand, for each e > 0, there exists N e N such that T^u — Na(c) ^ u + e, 
hence 

u' ^ lim T?f*u + (n - iV)a(c) - e > lim T c n-JV « + (n - iV)a(c) - e = u - e. 



We have proved that u 1 = u. 

The pairs (u, u) of fixed points of T c + a(c) and T c — a(c) which satisfy 

u = limTjTu — na(c) ; u = limT^u + na(c) 
are conjugate in the sense of Fathi. 



□ 
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(3.7) Proposition. The restriction to V of the function c : P — > H 1 (M,M.) is continuous 
and proper. 

Proof. Let us consider a compact subset C of H 1 (M, R). The Family of Hamiltonians H(t, x, c x + 
p), c € C, is a uniform family of Hamiltonians, see Appendix iBl As a consequence, the associated 
functions A c (0, .; 1, .), c £ C form an equi-semi-concave family of functions on M x M. As a con- 
sequence, the functions A c (0, x; 1, .),c£C,i6 M form an equi-semi-concave family of functions 
on M, see Appendix lAl It follows that the functions u(x) + A c (0, x; 1, .), c € C, x £ M also form 
an equi-semi-concave family, hence that the functions min^ u(x) + A c (0, x; 1, .), c 6 C form an 
equi-semi-concave family. As a consequence, the set $(Pc) is relatively compact. Since the set 
Vc is obviously closed, and contained in <5>(Pc), it is compact. rj 
We have proved the following Lemma, which is interesting in itself: 

Lemma. If C is a compact subset of H (-M,R), the set $(Pc) is equi-semi-concave. 

(3.8) Following Mather, we will use the function 

h c (x,y) := liminf A"(x, y) + na(c). 



In view of (3.2) the function h c (x, .) is a fixed point of T c + a(c). Similarly, the function —h c (., y) 



is a fixed point of T c — a(c). Let us recall here some basic properties of the function h c . 

• For each x,y, z 6 M and c s 7J 1 (M, M), we have the triangle inequality /i c (x, y) + h c (y, z) ^ 
h c (x, z). 

• For each x,y € M and c 6 H 1 (M, M), we have /i c (a;, y) + /i c (y, x) 5^ /i c (a;, ar) ^ 0, 

• For each compact set C C H 1 (M, R), the set of functions h c : M x M — ► l,c e C, is 
equi-semi-concave. 

(3.9) Proposition. If the pseudograph Q CjU is a fixed point of<&, then we have 

u(y) - u(x) < h c {x,y) 

for each x and y. In addition, 

u(x) = min u(y) + h c (y, x) = min u(a) + h c (a, x). 

yeM a£A{c) 

Proof. We have, for each n, u = T"u + na(c). As a consequence, for each n, 

u(x) = min (u(y) + AJO, y; n, x) + naicj) . 

yEM ' 

We obtain the inequality u(x) ^ u(y) + A c (0,y;n,x) + na(c) and, by taking the liminf, u(x) ^ 
u(y) + h c (y,x). In order to obtain the first equality, we consider a point y n G M such that 

u(x) = u(y n ) + A c (0, y n ; n, x) + na(c). 

We consider an increasing sequence n,}- of integers such that the subsequence y nk has a limit y, 
and refine this subsequence in such a way that the subsequence A c (0, y, nk, x) has a limit I. We 
have 

u(x) = u{y) + I u(y) + h c (y, x). 

Cumulated with the previously shown inequality, this proves the first equality in the statement. 
In order to prove the second equality, notice that the set of points y which minimize the function 



u(.) + h c (.,x) is precisely the set Q A G c ,-h c (.,x)i an d that G c ,-h c (.,x) £ »c- By (3.6) the set 



Q A Gc,-h a (.,x) intersects A(c). rj 
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(3.10) Corollary. For each x and y in M and c G H 1 {M, R), we have 

h c (x,y) = mm h c (x,z) + h c (z,y) = mm h c (x,a) + h c (a,y). 

z£M aeA(c) 

The following result connects our definition of the Aubry set to the one of Mather. 

(3.11) Proposition. The Aubry set A(c) is the set of points x such that h c (x,x) = 0. 

PROOF. Let us consider a Hamiltonian trajectory (x(t),p(t)) : M — > T*M such that (x(0),p(0)) G 
A(c). This trajectory is calibrated by each fixed point of T c + a(c), so in particular by h c (x(0), .). 
Consequently, we have 

h c (x(0), x{n)) - h c (x(0), x(0)) = A c (0, x(0); n, x(n)) + na(c). 

Taking a subsequence such that x(n) has a limit x, and then a subsequence such that A c (0, x(0); n, x) + 
na(c) is converging to a limit I /i c (x(0), x), we get, at the limit, 

h c (x(0), x) - h c (x(0),x(0)) > h c (x(0), x) 

thus /i c (x(0),x(0)) < and then h c (x(0), x(0)) = 0. We have proved that the function h c (x,x) 
vanishes on A(c). 

Conversely, let us assume that h c (x,x) — 0. Then there exists an increasing sequence nt of 
integers and a sequence of trajectories {xk(t),pk(t)) : [0, rife] — ► T*M such that x(0) = x(rife) = x 




L(t,x k {t),x k (t)) - c Xk(t )(x k (t)) + a(c)dt = A c (0,x;n k ,x) + n k a(c) — > 0. 



Let yk : [— n^, n^] — > M be the curve such that y k (t) = x k (t + rife) for — n k ^ t ^ and 
y k (t) — x k (t) for t ^ 0. The sequence y k is C 2 -bounded hence, by taking a subsequence, we 
can suppose that y k is converging with its derivative, uniformly on compact sets, to a limit 
y(t) : R — ► M. We claim that this limit y is calibrated by each fixed points of T c + a(c). Let u 
be a such a fixed point. We have, for each n G N and k large enough, 

^ u(y k (n)) - u(y k (-n)) - A c (-n, y k (-n);n, y k (n)) - 2na(c) 

= u(y k (n k )) - u(y k (-n k )) - A c (-n k , yk{-n k )\n kl y k (n)) - 2n k a(c) 
-(u(y k (n k )) - u(y k (n)) - A c (n,y k (n);n k ,y k (n)) - (n k - n)a(c)) 
-(u(yk(-n)) - u(y k (-n k )) - A c (-n k ,y k (-n k ); -n,y k (-n)) - (n k - n)a(c)) 
> u{y k (n k )) - u(y k (-n k )) - A c (-n k , yk{-n k );n k ,y k (n)) - 2n k a(c) 
= -A c (-n k , x; rife, x) - 2n k a(c) = -2A C (0, x; n k , x) - 2n k a(c). 
For fixed n, we now take the limit k — > oo, and get that 

u(y(n)) - u{y{-n)) = A c (-n, y(-n);n, y(n)) + 2na(c). 

Consequently, the curve y(t) is calibrated by u. Since this holds for each weak KAM solution u, 
we have x = y(0) G A(c). rj 



The following well-known result connects our definition of the Mane set with the usual one, 
and implies its compactness. 
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(3.12) Lemma The following properties are equivalent for a continuous curve P(t) = (x(t),p(t)) : 
R — > T*M. 

(i) The curve P(t) is a Hamiltonian trajectory and P(Z) C A/"(c). 

(ii) The curve P(t) satisfies p(t) = d v L(t,x(t),x(t)) and there exists Q CjU G V c such that, for 
each m ^ n in Z, we have 



u(x(m)) — u(x(n)) = / L(t, x(t), x(t)) — c x \t)(x(t))dt + (m — n)a(c). 

J n 

(Hi) The curve P(t) satisfies p(t) = d v L(t, x(t), x(t)) and for each m ^ n in Z, we have 

L(t, x(t), x(t)) — c x ( t ){x{t))dt + (m — n)a(c) = ^ rain A c (0, x(n); I, x(m)) + la(c). 

Proof. We shall prove that (Hi) =>■ (ii). The other implications are left to the reader. Let P(t) 
be a curve satisfying (Hi), let be an increasing sequence of integers such that x(—nk) has a 
limit a. Then we have, for m ^ n, 

L(t, x(t),x(t)) — c x m (x(t))dt + (m — n)a(c) 



L(t,x(t),x(t)) - c x ( t) (x(t)) + a(c)dt - / L(t,x(t),x(t)) - c x{t) (x(t)) + a(c) dt 
> J—nh 

= A c (-n kl x(-n k );m, x(m)) + (m + n k )a(c) - A c (-n k , x(-n k );n, x(n)) + (n + n k )a(c). 
By (iii), we have 

A c (— n k , x(— n k ); m, x(m)) + (m + n k )a(c) — min AJO, x(— n k ); I, x(m)) + la(c) 

ieN,i>o 

^ h c (x(-n k ), x(m)) 

which implies that 

A c (-n k , x(-n k );m, x(m)) + (m + n k )a(c) — ► h c (a, x(m)) 
as k — > co. Similarly, 

A c (~n k , x(-nk); n, x(n)) + (n + n k )a(c) — ► h c (a, x(n)), 

so that 



h c (a, x(m)) — h c (a, x(n)) = / L(t, x(t), x(t)) — c x ( t )(x(t))dt + (m — n)a(c). 

J n 

We have proved (ii) with u — h c (a, .). rj 

We now give equivalent definitions for the set £. The following Lemma shows that the set £ is the 
set called Q in [3], and implies its compactness. 
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(3.13) Lemma The following properties are equivalent for a continuous curve P(t) = (x(t),p(t)) : 
R — > T*M. 

(i) The curve P(t) is a Hamiltonian trajectory and P(Z) C £(c) . 

(ii) The curve P(t) satisfies p(t) — d v L(t, x(t), x(t)), and there exists a sequence u n of functions 
such that, for each to ^ n, we have T™~ n u n = u m and 



u m [x{m)) -u n {x{n)) = / L(t,x(t),x(t)) - c x ^(x(t))dt. 

J n 

(in) The curve P(t) satisfies p(t) = d v L(t,x(t),x(t)), and for each m ^? n, we have 

L(t, x(t),x(t)) — c x n\(x(t))dt = A c (n, x(n); m, x(m)) 



Proof, (ii) =>■ (i). Then for each pair to ^ n of integers, the curve x(t) : [n,m] — ► M is 
minimizing the action between its endpoints. Hence the curve P(t) is a Hamiltonian trajectory. 
It follows from (2.7) that, for each n ^ 0, we have P(n) G Q c ,u n and since P(n) = <p n (P(0)), we 
have 

P(0) e 0- n (*»(e c ,„ o ))- 

This inclusion holds for all n, so that P(0) G i(G c ,u )- Now (i) follows from the fact Gc,u £ ® 
and that T(G c ,u ) is invariant under <f>. 

(i) => (ii). There exists a pseudograph Gc.u & ® such that P(0) G I(Gc,u a )- There exists a 
sequence u n , n G Z of functions on M such that T™~ n u n = u m for to J? n. For each to 0, since 
P(m) G 5c,« m , we have 

u m (a;(m)) - u o (x(0)) = / L(t,x(t),x(t)) - c x{t) (x(t))dt. 
Jo 

On the other hand, for each n ^ 0, we can find by minimization a curve y n (t) : [n, 0] — ► M such 
that y n (0) = x(0) and 

«o(?/n(0)) -u n (y n (n)) = / L(t,y n (t),y n (t)) - c yn ( t) (y n (t))dt. 

J n 

There exists a subsequence such that the curves y nk (t) converge, uniformly on compact sets, 
to a limit y(t) : (-co, 0] — > M. By (1.3) this curve satisfies, for all n ^ 0, 

«o(y(0)) - u n {y{n)) = l L(t,y(t),y(t)) - c y{t) (y(t))dt. 

J n 

Hence, for n ^ $J to, we have 
u m (a:(m)) - u n (y(n)) = / L(t,y(t),y(t)) - c y{t) (y(t))dt + / L(t,x(t),x(t)) - c x{t) (x(t))dt. 

Jn JO 

As a consequence, the curve obtained by gluing y on R~ and x on R + is the projection of a 
Hamiltonian trajectory, which, by Cauchy-Lipschitz uniqueness, has to be P(t). In other words, 
we have proved that x(t) = y(t) on R~. The relation of calibration is now established. 
(Hi) =>• (ii). Let P(t) be a curve satisfying (Hi). Then we have, for to ^ n ^ fc, 



L(t, x(t),x(t)) — c x ( t )(x(t))dt + (to — n)a(c) 
A c (fc, ir(fc); to, ie(to)) + (to — k)a(c) — A c (k, x(k); n, x(n)) + (n — k)a(c). 
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Let us denote by the function 

u k( x ) — A c (k, x(k); n, x) + (n — k)a(c), 

we obviously have T™~ n u^. + (m — n)a(c) = u™ for m ^ n ^ fc. By diagonal extraction, we find 
an increasing sequence of integers such that u"L nk has a limit u n for each n as k — > oo. We 
then have T™ _Tl u rl + (m — n)a(c) = u rn for each m ^ n, so that C? C;U „ G O. In addition, we have 

p in 

/ L(t,x(t),x(t)) - c x ^(x(t))dt + (m - ri)a(c) = u m (x(m)) - u n (x(n)). 

J n 

(ii) => (in) is clear. rj 



(3.14) Lemma For each P G £(c), £/ie or&ii <p n (P) is a- asymptotic and u>- asymptotic to the 
Aubry set A(c). As a consequence, the Mather set M(c) is the closure of the union of the supports 
of the invariant measures of the action of 4> on £(c) 

Proof. Let P(t) = (x(t),p(t)) be the Hamiltonian orbit of P. Let u n ,n G Z be a sequence of 
continuous functions such that, for m ^ n, we have u m = T™~ n u n + (m — n)a(c) and 

r-va 

u m (x(m)) — u n (x(n)) = / Lit, x(t), x(t)) — c x ^(x(t))dt + (m — n)a(c). 



The sequence u m ,m G Z is equi-semi-concave, hence equi-Lipschitz. Together with (3.1) this 
implies that this sequence is equi-bounded. If v is a weak KAM solution, that is a fixed point of 
T c — a(c), we have, for m ^ n, 



v(x(m)) — v(x(n)) ^ / L(t, x(t), x(t)) — c x ^(x(t))dt + (m — n)a(c) 

J n 

It follows that the sequence n i — > u n (x(n)) — v(x(n)) is non-decreasing and bounded, so that 
it has a limit I as n — > — oo. Let us now consider an increasing sequence of integers such 
that the sequence P(t — rifc) converges, uniformly on compact sets, to a limit Z(t) = (y(t), z(t)) 
which is a Hamiltonian trajectory. Extracting a subsequence in n^, we can suppose that there 
exists a sequence w n of continuous functions on M such that u„_„ t — > w n uniformly, for each 
n, as k — > oo. Then, the sequence w n satisfies T™~ n w n = w rn for m ^ n. In addition, we have 
w n (y(n)) — v(y(ri)) = I and, for m ^ n, 



w m (y(m)) - w n (y(n)) = / L(t,y(t), y(t)) - c y ( t )(y(t))dt + (m - n)a(c). 
It follows that, for m ^ ri, 

v(x(m)) - v(x(n)) = I L(t,y(t),y(t)) - c y ^(y(t))dt + (m - ra)a(e) 



which implies that Z(Z) G i(G c ,v)- Since this holds for all weak KAM solutions v, we obtain that 
Z(1j) G A(c). We have proved that the trajectory P(t) is a-asymptotic to A(c). Similarly, one 
can prove that it is also w-asymptotic to A(c). This implies that the invariant measures of the 
action of <p on £(c) are supported on A(c). rj 



4 Static classes and heteroclinics 

In this section, we see that there is a natural partition of the Aubry set in compact invariant 
subsets, which we call static classes, following the terminology of Mane. This partition was first 
considered by Mather in [21]. We also discuss the existence of heteroclinic orbits between these 
static classes, extending to the non-autonomous case results of Fathi, Contreras and Paternain, see 
[18j and [llj . This survey is also an occasion to introduce several technical lemmas and notations 
to be used later. 



21 



(4.1) Lemma. Let x and y be two points in M. The following properties are equivalent: 

(i) The points x and y are in A{c) and the function z i — ► h c (x,z) — h c (y,z) is constant on 
A(c). 

(ii) h c (x,y) + h c (y,x) = 0. 

(Hi) The points x and y are in A(c) and, for each pair (G,Q) G V c x V c; either the set Q A Q 
contains x and y or it contains neither x nor y. 

If x and y satisfy these properties, we have, for each z G M, h c (x,z) = h c (x,y) + h c (y,z). 

Proof, i ii. Assuming i, we evaluate the constant function at x and y and get h c (x,x) — 
h c (y, x) = h c (x, y) - h c (y, y), hence h c (x, y) + h c (y, x) = 0. 

ii => Hi. We have h c (x,x) ^ h c (x,y) + h c (y,x) — hence x G -4(c). Similarly, y G A(c). Let 
us consider Q = Q c u G V c and Q = Q c % G V c such that x G Q A Q (such a pair exists because 
x G A(c)). We have to prove that y G Q A Q. We have the inequalities u(y) < u(x) + h c (x, y) and 
u(y) ^ ii(x) — h c (y,x). We obtain the inequality 

(u - u)(y) ^ (u- u)(x) + h c (x,y) + h c (y,x). 

As a consequence, if h c (x, y) + h c (y, x) = 0, then y is also a point of minimum of u — u, which is 
the desired result. 

Hi => ii. The point x is a point of minimum of the function h c (x, .) + h c (., x). As a consequence, 
the point y is also a point of minimum for this function, so that h c {x,y) + h c {y,x) = h c (x,x) + 
h c (x, x) = 0. 

ii => i. We have the inequalities 

h c (x, z) < h c (x, y) + h c (y, z) and h c (y, z) < h c (y, x) + h c (x, z). 

If h c (x, y) + h c (y, x) = 0, then these inequalities sum to an equality, hence they are both equalities. 

□ 

(4.2) The equivalent properties of the Lemma define an equivalence relation on A{c). We call 
static classes the classes of equivalence for this relation. In other words, we say that the points 
x and y of A(c) belong to the same static class if they satisfy (i), (ii) or (Hi) of the lemma. We 
usually denote by S a static class, and by S(x) the static class containing x. If S is a static class, 
we denote by S the set of points of A(c) whose projection on M belong to S. We will also call 
static classes the sets of the form S. The static classes S are compact and partition -4(c), the static 
classes S are compact, invariant, and they partition -4(c). The invariance is a direct consequence 
of the caracterisation (Hi) of the equivalence relation. To each point x of the Aubry set -4(c), we 
associate the weak KAM solution h c (x, .), and we denote by E CiX the associated element of V c . 
The pseudographs of this form are called elementary solutions of V c . Two points of a same static 
class give rise to the same elementary solution, we will denote by E c .s the elementary solution 
induced by points of S. There is a one to one correspondence between the set of static classes 
and the set of elementary solutions. We will denote by E c C V c this set. We endow it with the 
induced metric, it is clearly a compact set for this metric. We also denote by E c> s the fixed point 
of l> associated to the dual weak KAM solution —h(.,x) for x G S. 

(4.3) Proposition. Let Q G V c be a fixed point, and let P be a point of Q . The a-limit of 
the orbit <j> n (P) is contained in one static class S G -4(c). We also have P G E Ct s- In a similar 
way, if P G Q G V c , then the uj-limit of the orbit of P is contained in one static class of -4(c). 

Proof. Let a C M be the projection of the a-limit of the orbit of P G G c ,u- Note that this 
a-limit is contained in T(Q), so that it is a Lipschitz graph above a. We claim that, for each weak 
KAM solution or backward weak KAM solution v, the function u — v is constant on a. Clearly, 
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this implies that a is contained in a static class. In order to prove the claim, we consider the 
projection x(t) on M of the orbit of P. The curve x(t) is calibrated by u on (— oo, 0], hence the 
equality 

u(x(—m)) — u(x(—n)) — A c {—n, x(—n), — m, x(—m)) 

holds for all n, m G N such that to ^ n. On the other hand, if v is a weak KAM solution or a 
backward weak KAM solution, we have the inequality 

v(x(—m)) — v(x(—n)) ^ A c {— n, x(—n), —m, x(—m)) 

for all n,m G N such that to ^ n. We deduce that the sequence (it — v)(x(— n)) : N — ► K is 
non-increasing. Now let y = lim^oo x(— rife) and z = limfe—^ x(— rrtfe) be two points of a. We 
can suppose that nu ^ OTfc $J rifc+i by extracting subsequences. We obtain (it — i;)(x(— rife)) 
(it — u)(x(— mfe)) ^ (it — i>)(x(— rifc+i)), and at the limit (u — v)(y) ^ (it — u)(z) ^ (it — v)(y). 
Hence the function u — v is constant on a. This proves the first statement of the proposition. 

Taking v = /i c (a, .), we obtain that the sequence u(x(— n)) — h c {a, x{— n)) : N — > R is non- 
increasing. On the other hand, we have u(x(0)) — h c {a 1 x(0)) ^ u(a). It follows that the sequence 



is in fact constant, so that the curve x(t) is calibrated by E cS i a \ on (— oo,0], and, by (2. 



((as(0),p(0)) £E cMa) . n 



COROLLARY. Let P G A/"(c) be a point whose a-limit is contained in S and whose uj-limit is 
contained in S' . We have 

P 6 E C}S AE C}S '. 



Proof. Let (x(t),p{t)) be the orbit of P. Let a be an a-limit point of the curve x(t), and let 
lo be an w-limit point. It follows from the proposition that (x{m) , p(rn)) 6 i? c ,5 for each to G Z. 
Applying the discussions in the proof of the proposition with the point P = {x(m),p(m)) and the 
functions u = h c (a, .) and v — —h c (.,Lu), we get that the sequence h c {a 1 x(n)) + h c (x(n),u)) is 
non-decreasing on n ^ to. Since we can take any m G Z, this sequence is non-decreasing on Z. 
Taking a sequence to/c — > oo such that x(rrik) — ► w wc obtain the inequality 

/i c (a, w) ^ h c (a, x(n)) + /i c (:r(n), to) ^ lim(/i c (a, x(m k )) + h c (x(m k ), u)) = /i c (a, w). 

It follows that, for each n, 

h c (a,x(n)) + h c (x(n),u>) = h c (a,Lu) = min /i c (a, .) + h c (.,uj). 

This is precisely saying that 

x(n) G £^5(00 A i? c ,s( w )- 
Recalling that (:r(n),p(n)) G -E c ,<s, we obtain (a;(n),p(n)) G Ecs^AEc s^y rj 



(4.4) Lemma. // the static class S is isolated in -4(c), then there exists a neighborhood V of 
S in M such that the a-limit of every point P G E c .s satisfying ir(P) G V is contained in S. 

Proof. If the result did not hold true, we could find a sequence (x n ,Pn) G E Ct s that has a limit 
{x,p) G S and a sequence a„ of a-limit points of (x n ,p n ) that has a limit a in -4(c) — S. Note that 
the orbit (x n (t) , p n (t)) : (— oo, 0] — > T*M of (x n ,p n ) is contained in E Cj g. Hence it is calibrated 
by the function h c (x, .), that is 

h c (x, £„(0)) = h c (x, x n (-k)) + A c (-k, x n {—k); 0, x n (0)) + fca(c) 

for all k G N. At the liminf k — > oo, for fixed n, we obtain the inequality h c (x,x n ) ^ 
h c {x, a n ) + h c (a n , x n ) hence the equality h c (x, x n ) — h c (x, a n ) 4- h c (a n , x n ). At the limit n — > oo 
we get = h c (x,x) = h c (x,a) + h c (a,x). This is in contradiction with the fact that a and x do 
not belong to the same static class. m 



23 



(4.5) Let S and iS' be two different static classes in A(c). The set E Ci sAE c ^/ contains S and 
S' as well as other orbits of J\(c) . The following result is similar to Theorem A of [11] . 

Proposition. The set E c g A E c gi — (S U S') is not empty and contains points in every 
neighborhood of S, as well as in every neighborhood of S 1 . More precisely, if S and S' are two, 
possibly equal, static classes, and j/IC C 5 and fC 1 C S 1 are two disjoint compact invariant sets, 
then the set E c _s A_E Ci< s< — (/CU/C') contains points in every neighborhood of K,, as well as in every 
neighborhood of K,' . 

Proof. Let V be an open neighborhood of K. in M which does not intersect S' . Let us fix a 
recurrent orbit (y(t),z(t)) : K — > T*M such that (y(0),z(0)) = {y,z) e JC and a recurrent orbit 
(y'(t),z'(t)) : K — > T*M such that (y'(0), z'(0)) = (y',z') 6 K' . Consider a sequence n k G N 
of integers and a sequence (x k {t),p k {t)) ■ [0,n.fe] — ► T*M of Hamiltonian trajectories such that 
Xk(0) = U and x k (n k ) = y' and 

rnj, 

/ L(t,x k (t),x k {t)) - c :Efc (4)(i fc (t)) +a(c) dt = A c (0,y;n k ,y') + n k a(c) — > h c (y,y'). 
Jo 

We extend the curve x k : [0, n k ] — ► M to a curve : K — ► K by setting x k (t) = y(t) for i $C 
and x k (t) = y'(t — n k ) for t ^ n k . Let and b k be two increasing sequences of integers such 
that y(—a k ) — > y and y'(b k ) — ► y'. The existence of such sequences follows from the fact that 
the curves y(t) and y'(t) are recurrent. Since the curve y(t) is calibrated by h c (y, .), we have, as 

k — > oo, 

A c (-a k , y(-Ofc); 0, y) + a k a(c) = -h c (y, y{-a k )) — > 

and similarly 

A c (0, y'\ b k , y k {b k )) + b k a(c) = h c (y', y(b k )) — ► 0. 
As a consequence, we have, as k — > oo, 

A c (-a k) x k (-a k ); b k + n k ,x k (b k + n k )) + (b k + a k + n k )a(c) — > h c (y, y'). 

For each k, let T k be the maximum of all times i £ N such that x k (i) G V. Note that x k (T k + l) does 
not belong to V. We can assume, taking a subsequence, that the curve x k (t + T k ) is converging, 
uniformly on compact sets to a limit x(t) : R — ► M. Let us now fix m ^ n in Z. Summing the 
inequalities 

liminf ( A c (-a k , x k (-a k ); T k + m,x k (T k + m)) + (T k +m + a k )a(c)) ^ h c (y,x(m)), 

k >oo V / 

liminf ( A c (T k + m, x k (T k + m);T k + n,x k (T k + n))) = A c (m,x(m); n,x(n)) 

k >oc V / 

and 

liminf [A c (T k + n,x k (T k + n);b k + n k ,x k (b k + n k )j) + (b k + n k - T k - n)a(c)) ^ h c (x(n),y'), 

k 'oo V / 

we get 

h(y,y') = liminf A c (-a k ,x k (-a k );b k +n k ,x k (b k + n k )) + (b k + a k + n k )a(c) 

k *oo 

^ h c (y, x(m)) + A c (m, x(m); n, x(n)) + (n — m)a(c) + h c (x(n),y'). 
Since the converse inequality obviously holds, we obtain the equality 

hc(y, y') = h c {y, x(m)) + A c (m, x(m);n, x(n)) + (m - ra)a(c) + h c (x(n), y'), 

for all m ^ n. It follows that all the inequalities above are in fact equalities, so that we also have 

h c (y, x{m)) + A c (m, x(m); n, x(n)) + (m — n)a(c) = h c (y, x(n)) 
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so that the orbit x(t) is calibrated by the weak KAM solution h c (y, .) on R. Hence it is the 
projection of a Hanhltonian trajectory (x(t),p(t)). Moreover, we have the equality 

h c(y, y') = h c (y, x(n)) + h c (x(n),y'), 

so that the point x(n) is a point of minimum of the function h c (y, .) + h c (., y'). Hence it belongs 
to E c s A E c ,s'- We have proved that the sequence (x(n),p(n)),n G Z is an orbit of <j> which is 
contained in the invariant graph E Ct sAE Ct s>- Since the point x(l) is not a point of /C, this orbit 
does not intersect the invariant set K,. As a consequence, the point x(0) belongs to V — K. We 
have proved that the set E c ,s A E C ,S' — QC U K!) contains points in each neighborhood of JC. One 
can prove in a similar way that this set contains points in every neighborhood of KJ . m 



(4.6) Corollary. A static class S cannot be decomposed as the union of two disjoint 
invariant compact subsets. 

Proof. Assume, by contradiction, that there exists a static class S = K,\ UAC2, with invariant, 
compact and disjoint. In view of (4.5) the set 

E c ,s A E c , s -(/CiU£ 2 ) 

is not empty. This is a contradiction since E c g A E c $ = S and K\ U K.2 = S. q 



(4.7) Let (x(t),p(t)) : R — ► T*M be an orbit of the Mane set, that is an orbit satisfying 
(x(0),p(0)) G A/"(c). This orbit is a-asymptotic to a static class S, and w-asymptotic to a static 
class S' . 

Lemma. The inclusion (x(0),p(0)) G -4(c) holds if and only if S = S' . In this case, we have 
(x(0),p(0)) eS 



Proof. Let us first assume that S = S' . In this case, we see from Corollary (4.3) that 
(x(0),p(0)) G E Ct s7\E Ct s- But is is clear from the definition of static classes that E Ct g/\E c .s = S. 
Consequently, we have (x(0),p(0)) G S C -4(c). Conversely, assume that (x(0),p(0)) G -4(c). 
Then this point is contained in one static class iSo- Since this static class is compact and invariant, 
it contains the a and the w- limits of the orbit (x(t),p(t)), so that we have S = Sq = S' . q 

Corollary We have the equality A{c) — Jv(c) if and only if there is exactly one static class in 
-4(c). 

(4.8) Let H C (S, S') be the set of orbits of M(c) which are heteroclinic orbits between the static 
classes S and S' , we denote by 7i c (S,S') its projection on M. We have 

Af(c)=A(c)U (J H C (S,S'), 

S,S' 



where the union is taken on all pairs (5, S') of different static classes. Recall, from Corollary (4.3) 
that 

H C (S,S') cE CtS AE Ct s>. 
The following result is from [18] and [TTj . 

(4.9) proposition. If the static class S is properly contained and isolated in -4(c), then there 
exists an orbit of <f> in A/"(c) — -4(c) which is a-asymptotic to S. This orbit is then cu-asymptotic 
to another static class S' . 



Proof. Let us chose, according to (4.4) a neighborhood V of S such that every orbit of E Ct s 
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starting above V has its a-limit contained in S. Now let us choose any static class S" different 
from S. In view of |(4.5)| the set E c . s f\E c . s „ intersects V-S. Let P(t) = (x{t),p(t)) : K — > T*M 
be an orbit such that P(0) G E Cj sAE Ct s>< and x(0) el'-S. The a-limit of the orbit P(i) is con- 
tained in S. On the other hand, this orbits belongs to A/"(c), hence its w-umit is contained in some 
static class S' . rj 



(4.10) We have treated so far the case where there exist several static classes. We recall, 
however that the existence of a single static class in A(c), is, for c fixed, a generic property of the 
Lagrangian, see [11] . We will explain in section [7] a device due to Fathi, as well as Contreras and 
Paternain, see [TH] and [TT], which allows to treat this case. 

Abstract mechanisms 

5 The relation and its dynamical consequences 

We define the forcing relation HK and describe its dynamical consequences. We prove Propo- 



sition 



(0.10) 



(5.1) Let us introduce some useful notations. Given two subsets Q and Q 1 of T*M, we define 
the relation Q \~m 9' as follows: 

N 

9 hv 9' 9' c |J r{9), 

n=l 

where as usual Q is the closure of Q. We say that Q forces Q' , and write Q h Q' if there exists an 
integer N such that 9^n 9'- If 9 is a subset of T*M and if c G iP^M, M), the relations 

Q h c and C/ hjy c 

mean that there exists an overlapping pseudograph of cohomology c and such that Q \- Q 1 (resp. 
9 \~n 9')- To finish, for c and c' two cohomology classes, the relation 

C hjv C 

means that, for each pseudograph G P c , we have 9\~n As the reader may have guessed, we 
will then say that c forces c' (c h c') if there exists an integer N such that c hjy c'. The relation 
h (between subsets as well as between cohomology classes) is obviously transitive. We will be 
concerned in this paper with understanding the relation h between cohomology classes. For this 
purpose, it is useful to introduce the symmetric relation 

cHhc' c h c' and c' h c. 

We say that c and d force each other if cHhc'. 

Proposition The forcing relation Hh is an equivalence relation on P^ 1 (M, R). 

Note that we have c hi c for each c since Q(9) C 0(0) for each G P c , which can be written 

9H M9). 

(5.2) Let us present a simple (negative) result about this relation. If Q is a the graph of a 
continuous section of T*M, and is invariant under cf>, then Q G V n V is in fact a Lipschitz graph, 
and the relation c{9) b c holds if and only if c = c(Q). Note that, if C C H 1 (M, R) is bounded, 
it is possible to chose a uniform constant K such that all the invariant Lipschitz Graphs Q whose 
cohomology satisfies c G C are if-Lipschitz. In other words, the elements of Yc H V are equi- 
Lipschitz graphs. Of course, we would like to be able to prove that the forcing relation Hb has 



non-trivial classes. We first restate and prove Proposition (0.10) 
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(5.3) Proposition 

(i) If the cohomology class c forces the cohomology class d , there exists a heteroclinic trajectory 
of the Hamiltonian flow between A{c) and Aid). For any closed forms 77 of cohomology c and 
T] 1 of cohomology c' , there exists a positive integer N and a trajectory (q(t),p(t)) : [0, N] — > 
T*M of the Hamiltonian flow such that p(0) = ?7g(o) and p(N) = VqtN)- There exists a 

trajectory (q(t),p(t)) : [0, 00) > T*M which satisfies p(0) — ?? g (o) and is to -asymptotic to 

A(d). There exists a trajectory (q(t),p(t)) : (— 00, 0] — ► T*M which satisfies p(0) = rf q rm 
and is a-asymptotic to A(c). 

(ii) Let a, i G Z, be a sequence of cohomology classes such that Ci forces Cj+i for each i 6 Z. Fix 
for each i a neighborhood Ui of M(ci) in T*M . There exists a trajectory of the Hamiltonian 
flow which visits in turn all the sets Ui. In addition, if the sequence stabilizes to c— on the 
left, or to c+ on the right, the trajectory can be assumed negatively asymptotic to A(c— ) or 
positively asymptotic to A(c+). 

Proof. Let us first assume that c h d. Take a fixed point Q c G V c . There exists a graph 



Q G F c i such that Q c h Q. Now, consider a pseudograph Gd G V c <. It follows from Lemma (2.3) 



that Q intersects Gd- In view of (4.3) the points of intersection are a-asymptotic to Aid) and 
w-asymptotic to A(d). In the same way, we can take for Q c the graph of the closed form 77, choose 
Q G P c ' such that Q c h Q, and take for Q c / the graph of 77'. The points of the intersection Q n G c ' 
have trajectories from Q c to Gc 1 - The other statements of (i) are proved similarly. 

(5.4) Lemma Let us fix a cohomology c. 

(i) For each neighborhood U of E{d), there exists JVeN such that, for all I ^ N and all Q G P c , 
we have 

' ' G U. 



(ii) IfV is an open neighborhood of M.{d) in T*M , there exists N G N such that, for each Q G P c 
and each P G $ N (G), one of the points 4>~ l (P), 1 < i < N — 1 belongs to V. 

Proof. In order to prove (i), it is sufficient to prove that, if Q n G P c is a sequence of pseudographs, 
if m n is an increasing sequence of integers, and if (x n (t),p n (t)) : [0, m n ] — ► T*M is a Hamiltonian 
trajectory which satisfies 

{x n (m n ),p n {m n )) G <S> 2m "{G n ) 

and which converges uniformly on compact sets to a limit (x(t),p(t)) : M + — > T*M, then 
(x(0),p(0)) e £ (c). 

Let us write the pseudographs <& mn (Gn) on the form Q c .u n - For each k,n G N, we have 

(*)) 

(0))+ / L(t,x n (t),x n (t)) + c Xn{t) (x n (t))dt. 
Jo 

Since the functions u n lie in the image of the operator T™", they are equi-Lipschitz, and there 
exists a real sequence A ra such that the sequence of functions A„ +u n has an accumulation points in 
C(M, M). As a consequence, we can assume, taking a subsequence if necessary, that the functions 
An +u n converge uniformly to a limit u. We have G c ,u = um ® mn [Gn ) G O c . For each fixed k G Z, 
taking the limit as n — ► 00, we get 

T*u(x(k)) = u(x(0)) + / L(t,x(t),x(t)) + c x{t) (x(t))dt. 
Jo 

Hence we have P{k - 1) G $ fc_1 (^c,«), and therefore P(0) G <p 1 ^ k {<i >k ^ 1 (Gc,u))- Since this holds 
for all k G N, we conclude that 

P(0) G i(Gc,u) C £{d). 
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In order to prove (ii), it is useful to recall that £(c) is a compact set, invariant under the time- 
one flow 4>i and that the Mather set A4(c) is the union of the supports of the invariant measures 
of the action of 4> on £ (c). The claim below follows from general facts about topological dynamics 
on compact spaces: For each neighborhood W of Ai(c) in £ (c), there exists an integer k such that, 
for each point P of £(c), one of the points 4> 1 {P), 1 ^ i ^ k, belongs to W. As a consequence, if V 
is a neighborhood of A4(c) in T*M, there exists a neighborhood U of £(c) in T*M such that, for 
each P G f , one of the points </> 8 (P), 1 ^ i ^ k, belongs to V. Now let us take I ^ fe such that (i) 
holds for this neighborhood U, and set N — 21. For each 5eP c and each P G < & Ar ((/), we have 
4>~ l (P) G J7. Hence one of the points 4 ~'(P), 1 ^ i < fc is in V, which proves (m). rj 



(5.5) Let us now prove (ii) of the proposition. Let M, G N, z G Z be a sequence of integers such 



that at \~Mi c i+i, and let Wi C Vi be compact neighborhoods of .M(cj). In view of lemma (5.4) 
there exists a sequence Ni of integers such that, for each Q G P Ci and each 



one of the points 4> l (P), ^ I ^ Ni belongs to Wi. 

Let us first fix an integer k G N, and choose a pseudograph Q_ k G P c _ fc - Since c_fc l~M_ fc ci_fc, 
there exists a pseudograph G P C i_ fc such that & N - k (Q^ k ) l~M_ fc 5f_ fc - We build, by induction, 
a sequence C/f G P Ci ,z — fc, of pseudographs such that 

for each i — fc. 

Let us now take a point P^ G Q\. There exists a positive integer l\_ x ^ Mk-i such that 
0-'£-i(pfc) G $^ h _i(gjfc_ i ) < Wc thcn set pfc_ i = ^-(/J-j+JVfc-i)^^ this point belongs to 

We can build a sequence Pf , — fc ^ i ^ k of points of and a sequence if,— fc^i^fc — lof 
integers satisfying < if < Mi such that 

for each i. In addition, one of the points (^(Pf), ^ j ^ N belongs to Wi 

There exists an increasing sequence k n of integers such that each of the sequences n i — ► l* 
for fixed i, is the constant U after a certain rank, and each of the sequences n i — > P/ ™, for fixed 
i, is converging to Pi. Clearly, we have cf> li+Ni (Pi) = Pi+i for each i G Z, and one of the points 
(j^ (Pi), < j < iVj belongs to Wj. This proves the main part of the statement. 

If the sequence q stabilizes to c— on the right, then it is possible to build a sequence Qi G P Ci 
as above which stabilizes to Q— G V c _ on the right, and we obtain by the above method an 
orbit which is a-asymptotic to A(c—) and then visits in turn all the sets Wj. If the sequence Cj 
stabilizes to c+ on the right, say for i ^ I, then it is possible to impose that Pj G Q+ G Y c + in 
the construction above, and we then obtain an orbit which is w-asymptotic to A(c+). rj 



<P N ^ (P?) = P? 



i+l 

k \ 



6 Evolution operators 

We define operators on P that generalize the Lax-Oleinik operator $. These operators will 
play a central role in the proof of our main results. 

(6.1) Given two integers N' ^ N ^ 1, and a cohomology c, we define the function A^ ,N : 
M x M — ► M by the expression 

A?' N '(x,y)= min A c (0, x; k, y) + ka(c). 
Since each of the mappings 

H\M,R) — > C(M x M,K) 
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ci — > A c (0,.;k,.) 

is continuous (see appendix [Bj, it is easy to see that, for fixed N' N, the mapping 

if^MjR) — > C(M x M,R) 
c -> ^ 

is continuous. 

Proposition Let c be a fixed cohomology class. For each e > 0, there exist integers N' ^ N ^ 1 
such that 

||AW'-Moo<e. 

More precisely, there exists an integer Nq and a function A : N — ► N such that the conclusion 
holds ifN^No and N' > A(N). 

Proof. The functions A^> N , N ^ N' € N, and the function h c have a common modulus of 
continuity and a common uniform bound. As a consequence, the pointwise limit 

h c (x, y) = lim lim A^ N (x, y) 

N >oo N' >oo 

is uniform. n 



(6.2) It is useful to generalize the operators Q N : P — ► P. Given two integers N' ^ N ^ 1 and 
an open set U C M, we define the operator 

$N,N> . p _^ p 

by the relation &y' N (Q c ,u) = S cT n,n> u where 

T^r'f 4 u(x) = min T^u(y) + ka(c) = miritt(y) + ^4^'^ (y,x). 
For simplicity we will denote by & N < N the operator $ M ' . For each Q 6 P, we have 

g\-n> s> N < N '(g). 

Lemma. For each integers 1 ^ N N' and each open set U C M , the operator $^ ,JV : P — ► P 
is continuous, when the source is endowed with the seminorm \\.\\u an d the image with the norm 



\\.\\, see (2.2) 



u 



Proof. Let Q — Q CM and Q\ — Q Cu m be two pseudographs. We have 

W^N.N' rr> \ x*N,N' /r>\\\ ^ I I i \\rrN,N' rrN,N' 

Pj/' (Gi)-^u (0)11 < c i -c| + \\T Ci ' tU Mi -T c ^ 
In order to estimate the term \\T^'^ u\ — T^ N u||, let us write 

iy« = «d,)+^ w '(» lJ ;) 

with y £ U. Then, we have 

T^'ux - T^'u < ^(y) + A% N '(y, x) - u(y) - Af N \y, x) 
and by symmetry 

11*3^ - T cfA < "Up M,) - «(»)| + - 



The conclusion follows from the continuity of the mapping c i — > A^' , see (6.1) 



□ 
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(6.3) Similarly, we define the operator 

$^ : P — > V 
by the relation <E>~ (Gc,u) = Qc,t^ v u where 

T^uu(x) = minu(y) + h c (y,x). 

In the autonomous case Fathi proved that the sequence is converging to a fixed point of $ 

for each Q € P. Such a result would be very useful to us, but does not hold in our non- autonomous 
setting. It is replaced by the following one. 

Proposition Let c be a fixed cohomology class. For each e > there exist integers N ^ N' such 
that, for each pseudograph Q = Q CjU € P c and each open set U C M , we have 

\\*5> N '(g)-*%(g)\\<e. 

More precisely, there exists an integer No and a function A : N — ► N such that the conclusion 
holds ifN^N and N' ^ A(N). 

Proof. It is not hard to see that, for each continuous function u, 

\\T*fu-T™ uU \\^\\A^ N '-h c \\. 



The proposition follows from (6.1) 



□ 



(6.4) Proposition Let Qo = Q co ,u G P 6e a pseudograph, and let e > be fixed. Assume that 
there exists an open set U C M and two compact sets fC C U and K,\ C M such that, for each 
x G JCi, the minimum in the expression T^ u Uo(x) = min yg ^ uo{y) + h Co (y,x) is never reached 
outside of K. Then there exists integers N ^ N' , a positive number S and an open neighborhood 
U\ 0//C1 such that, for each pseudograph Q € P satisfying \Q — Qo\u ^ 5 we have 

g ll7 h N , ^ n \g) Wi . 

More precisely, there exists an integer Nq and a function A : N — ► N such that the conclusion 
holds if N ^ N and N' > A(N). 

Proof. Let us denote by dU the boundary of U. There exists a positive number e and a 
neighborhood U\ of K.\ such that, for each x G Ui, 

min u (y) + h Co (y,x) ^ minw (y) + h Ca (y,x) + 7e. 

yedU y&J 



In view of (6.1) there exist integers N and N' such that 



iC-^ii^. 



For fixed N and N', the function A^' N depends continuously on c G if 1 (M, M), see (6.1) As a 
consequence, if c is sufficiently close to Cq , we have 



lA N,N'_ A N,N' {l<e . 



For these values of N and N\ if u € C(M,M) is such that supjj \u — uo\ ^ e, we have, for each 
x G M and y G U, 

\uo(y) + h Co (y,x) - u(y) - A^' N (y,x)\ < 3e. 
Hence we have the inequality 



mm u{y) + A^ N ' (y, x) > min u(y) + A? > N ' (y, x) 

y€dU y£U 
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As a consequence, if \\Q c ,u — Go\\u is sufficiently small, then there exists a compact set Kl C U 
such that the minimum in the expression 

T cU N = min w(?/) + A% - N (y, x) 
is reached in K! for all x G C/j.. Now let us set v — T c ^ u and consider a point 



(x,p) G Q c ,v 



The point (x,p) is the limit of a sequence (x n ,p n ) £ G c ,v\U\- I n other words, the points x n G U\ are 
points of differentiability of v, and we have dv Xn +c Xn — p n . Let y n G K! and k n G N, N ^ fe„ ^ iV, 
satisfy 

u(ar„) = u(j/„) + A c (0,y n ;k n ,x„) + fe„a(c). 

By extracting a subsequence, we can suppose that the sequence k n is a constant k. By arguments 
similar to those of (2.7) recalling that the function u is semi-concave, we conclude that the function 
u is diffcrentiable at y n , and, setting z n = c Vn + du Vn , that (f> k (y n ,z n ) — (x n ,p n ). By extracting 
another subsequence, we can suppose that the sequence y n has a limit y G Kl . We then have 

v(x) = u(y) + A c (0, y; k, x) + ka(c), 

so that the function u is differentiable at y. Since the function u is semi-concave, we then have 
du y = \imduy nl see Appendix (A. 9) At the limit in c/> k (y n , z n ) = (x„,p„), we get <fi k (y, z) = (x,p), 
where z := dv y + c y . We have proved that 

N' 



Q c ,v\ui c [J 4> k (G c ,u\u)- 



k=N 

□ 



(6.5) Proposition Let c and c' be two cohomology classes. Assume that, for each weak KAM 
solution Go G V c , there exists a positive number e > and an integer N with the following property: 
For each pseudograph G G P c such that \\G — Go\\ ^ e, there exists a pseudograph G' G P c ' such that 
G r-jv G' ■ Then c\- d . 

Proof. By compactness of V c , there exists a neighborhood U of V c in P c and an integer N such 
that, for all G G U, we have G \~n c 1 . In view of Proposition (6.3) there exist integers k ^ k' such 
that $ fe,fe ' (G) G U for each G G P c . We obtain, for each G G P c , the existence of a G' G P c / such 
that 

GH> <5> k > k \G) ^ N G' 

so that G l-fc'+jv G' ■ □ 



7 Coverings 

As was noticed by Fathi, as well as Contreras and Paternain, see [18] and [11], it is useful to 
study the effect of taking finite Galois coverings. 

(7.1) Let P : M Q — ► M be a finite connected covering, and P* : H l {M, R) — > H 1 (M 0l M) the 
induced mapping. Let us also denote by L o TP : R x TMo — > R the lifted Lagrangian 

LoTP(t,x,v) = L(t,P(x),dP x (v)), 

and by T*P : T*M — > T*M the covering 

(x,p) ^ (P(x),podP- 1 ). 
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The lifted Hamiltonian HoT*P is in natural duality with the Lagrangian LoTP. As a consequence, 
the Hamiltonian flow associated to the Lagrangian L o TP is the Hamiltonian flow of H o T*P, 
which is the lifting of the Hamiltonian flow of H . Each overlapping pseudograph Q = Q c . u on M 
lifts to a pseudograph 

p*q ■-T*p- 1 (g) = g P * c ^ oP 

on M . Note that c{P*Q) = P*(c(Q)). It is not hard to see that the Aubry set A Lo tp(P*(c)) 
associated to L o TP on Mq is precisely 



iLoTp(P*(c)) =T*P- 1 (Al(c)), 



while we only have the inclusion 



AW(P*(c)) D T*P-\M l (c))- 



Finally, if S^otp is a static class of AloTp{P*( c )) , then P{Slotp) is a static class of Al(c). Note 
however that the lifting P~ 1 (Sl) of a static class of Al(c) can contain several static classes of 



AloTp{P*{c))- This is illustrated by the following result which, in conjunction with (4.9) allows 



to prove the existence of heteroclinic orbits in the case where there is only one static class, see [TH| 
and We need first another definition. If X C T*M is an invariant set of the time-one flow cf>, 
then we denote by sX C T*M x T the set U 4gR a;e< £(<^o( :E )i an d by sX its projection on M x T. 

(7.2) Proposition. Assume that the set A(c) contains finitely many static classes, and that 
there exists an open neighborhood U C M X T of the compact set sA(c) such that the mapping 
h : Hi(U,Z) — ► Hi(M,Z) is not surjective, where h is the composition of the mappings 



Hi(U,Z) Hi(M xT,Z)^ Fi(M,Z) 

induced from the inclusion and the projection. Then there exists a finite connected Galois covering 
P : Mq — ► M with k sheets, k 2, such that, for each static class S of A{c), the lifting T*P~ 1 (S) 
is the union of exactly k different static classes of AloTp(P*(c)). 

Proof. Let N be the number of static classes in A(c). First, we claim that for each static class 
S, the set sS is connected. This follows easily from (4.6) As a consequence, we can suppose that 
the neighborhood U is a union of finitely many connected open sets Ui, 1 ^ i ^ JV, each of which 
contains exactly one of the sets sS. Since the group 7? 1 (Af, Z) is Abelian and of finite type, and 
since the mapping h : H\(U,Z) — > Hi(M,Z) is not surjective, there exists an integer k ^ 2 and 
a surjective morphism g : H 1 (M,Z) — ► Z/fcZ whose kernel contains the subgroup h(Hi(U,Z)). 
There is a connected Galois covering P : Mo — ► M with k sheets associated to this morphism. 
This means that, if \ '■ k^M) — > Hi(M, 1) is the Hurewitz map, then the image P*(7Ti(Mo)) in 
7Tx(-M) is precisely the kernel of g o x- The following diagram commutes. 



7Tl(Mo x T) 



(Pxld), 



Hx(U,R) 



m(M x T) 



Hx(M x T,R) 



7Tl(M ) 

P, 



Hi(M,R) 



Z/kZ 



We claim that 



i*(m{U)) C (P x IdUnM x T)), 



which implies that the covering P x Id is trivial above U. In order to prove the claim, let us first 
notice that j o ^ o p, o j, = g op, o i* o x ■ ^i(U) — > Z/fcZ is the zero map. This implies that 
the image of the map i* : tt\(U) — > tti(M x T) is contained in the kernel of g o \ o p* . In order 
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to finish the proof of the claim, we check that the image of (P x Id)* is precisely the kernel of 
g o \ °P*- This follows from the fact ker(<? o x) = im(P*), and from the fact that the upper square 
of the diagram can be identified with 

7Tl(M ) X Z 
P, xld 
7Tl(M) X Z 

where the horizontal arrows are projections on the first factor. The claim is proved, so that the 
covering P x Id is trivial above U. It follows that each connected component Ui of U has k 
disjoint connected preimages Vf C Mo x T. Now it is not hard to see that the static classes of 
AloTp{P*{c)) are precisely the intersections 

TP-^Aic)) n Vj = A L otp{P*{c)) n Vf, 1 < * < N, 1 < j < k. 

□ 



* 7Tl(M ) 

'4 

* 7Ti(M) 



(7.3) Proposition. Let P : Mo — > M fee a /im'ie Galois covering. Let c and c' fee too 
cohomology classes in iJ 1 (M, R). If P*(c) \~n P*{c') for the forcing relation associated to the 
Lagrangian L o TP on Mq, then c hjy c'. 

Proof. Let us consider a pseudograph Q C P c . If P*{c) P*{c') then there exists a pseudo- 
graph Q' on M of cohomology P*(c') and such that hjy G' ■ Let D be the group of deck 
transformations of the covering P. The elements of D are the diffeomorphisms D of Mq such that 
PoD = P. To each element D of D we associate the fibered diffeomorphism T*D of T*M defined 
by 

T*D(x,p) = (D(x),podD- 1 ). 

This diffeomorphism is a Deck transformation of the covering T*P. Let us prove that there 
exists a pseudograph G" on Mq which is invariant by deck transformations, which has cohomology 
P*(c'), and such that P*G G" ■ Let ij be a form on M with cohomology c', and let P*n be its 
lifting to Mo. We write 5' on the form Gp*rj.u- Since the flow of H o T*P commutes with Deck 
transformations, and since the pseudograph is invariant by deck transformations, we have 

P*Q = T*D(P*G) T*D(G') 

for each deck transformation D. It is easy to check that T*D(Q') = Gp'n^uoD- 1 ■ Setting 

v := min u o D^ 1 , 

and Q" = Gr),vi we have Q" C Ud£d7 1 *-D(^') hence P*G G", and we have the desired properties 
for G" ■ Since P is a Galois covering, functions on Mq which are invariant by deck transformations 
are liftings of functions on M. As a consequence, there exists a continuous function w : M — > R 
such that v — wo P. Hence the pseudograph Q" is the lifting of the pseudograph Gr\,w on M. Since 
P*G G" = P*G v ,w, we have G \~n G, h w We have asssociated, to each pseudograph 5 e P c , a 
pseudograph G v , w G Pc' such that G G v ,w This proves that c hjy c' rj 



8 Mather's mechanism 



We comment and prove Theorem (0.11) Let us first discuss some properties of the subspace 



R(c) as defined in (0.11) 
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(8.1) It is useful to consider the Cech cohomology H(.,M) with real coefficients. Recall that 
H(.,M) is the De Rham cohomology. We identify the De Rham cohomology H 1 (M,M.) with the 
Cech cohomology H 1 (M, R) . If K is any subset of M, we denote by i* K the mapping H 1 (M, R) — > 
R) induced from the inclusion %k ■ K — > M. Recalling that the subspace R(G) was defined 



(0.11) we have: 



Lemma. For each Q e V c , we have R(G) = ker(£J,gs). 

Proof. Consider an open neighborhood Vb of 1(G) which is such that, for each open neighborhood 
V C Vo of 1(G) in M, R(G) is the set of cohomology classes of smooth closed one-forms which 
vanish on V. Let us fix an open neighborhood V C Vo of T(G) in M. Clearly, the cohomology 
classes of smooth closed one-forms which vanish on Vb belong to ker(iy) (where i v is the mapping 
associated to the inclusion in De Rham cohomology). We have proved the inclusion R(G) C 
ker(iy). Conversely, let u> be a smooth closed one-form on M whose De Rham cohomology belongs 
to ker(iy). This means that the restricted form u)\ v is exact. Hence there exists a smooth function 
/ on V such that uiiy = df. There exists a smooth function / : M — ► R which is equal to / in a 
neighborhood V C V oil(G). The form uj — df is a smooth closed form on M, cohomologous to 
lo, and vanishing on V. As a consequence, we have [u>] = [u> — d/] £ R(G)- We have proved that 

ker(*vO = R@) 

for all open neighborhood V C Vb of 1(G) in M. The Lemma follows because ker(ij^) is equal 
to ker(iy) when 1/ is a sufficiently small open neighborhood of 1(G) in M. rj 



(8.2) In order to avoid confusion, we shall denote by : JC — ► T*M the inclusion of a sub- 
set t of T*M into T*M, and by j£ : ff^l^MjR) — > ff^R) the associated mapping in 
Cech cohomology. We identifying the Cech cohomology 7J 1 (T*M, M) with the De Rham coho- 
mology ff^I^M.R), and the mapping tt* : ff^M.R) — ► i/^T*!/^) with tt* : H X (M,R) — ► 
iT^M, R). 

Lemma. We /lane (7r*) _1 ( ker(jf^.. )) C R(c). 

PROOF. It is enough to prove that, for each G € V c , we have kerQP^., .) C n*(R(G))- For each 

G £ V c , we have 1(G) C JV(c), hence ker(J*- ) C ker(j^. ). So it is enough to prove that the in- 

elusion ker(Ji ) C ir*(R(G)) holds for each G V c . Let us consider such a pseudograph C?. Since 

the projection 7r : TM — ► M induces a homeomorphism ""ixrg) ■ -^(^) — > ^-(G)i the commutative 
diagram 

TM J(£) 

7r| 7r |i(S)| 

M J™-I(g) 
gives rise in Cech cohomology to the diagram 

ff x (TM,R) = ff^TM,!) 3£(6) > H\l(G),R) 



ff 1 (M,R) = H^M,^) I(S) ) tf^J^.R) 
where the vertical arrows are isomorphisms. We conclude that 

ker(j| (e) ) = r (ker(z* (e) )) = 7r*(ii(0)). 

□ 
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(8.3) Lemma. The space R{c) C H (M, R) depends semi- continuously on c in the following 
sense: For each cq £ H 1 (M, R), there exists a neighborhood V of cq in H (M, R) such that, for 
each c £ V, we have R(cq) C R(c). 

Proof. Let us fix a cohomology class Cq. We claim that, for each C?o € V co , there exists eo > 
such that each fixed pseudograph Q of V which satisfies \\Q — Go\\ ^ e has to satisfy 

R(Go) c R(Q). 

This claim follows from the existence of a neighborhood U of I (Go) such that R(Go) is the set 
of cohomology classes of smooth closed one-forms which vanish on U, and from the fact that the 
inclusion 1(G) C U holds when G is sufficiently close to Go- Let B-p(G, e) denote the open ball of 
center and radius e in P. The compact set V Co is covered by a finite family of balls Bp(Gi,£i) 
such that Gi £ V Co and such that R(Gi) C for each € Bp(Gi,£i). Since the map c is 

continuous and proper on V, see (3.7) [ there exists a 5 > such that, for |c — Co ^ <5, we have 



C UjBp(^, £j). As a consequence, if belongs to some V c with |c — Co ^ S, then there exists 
i such that R(c ) C fl(ft) C R(G). We conclude that R(c ) C i?(c) for |c - cq\ < o". □ 



The following proposition is the main step in the proof of Theorem (0.11) We denote by Be{t) 



the open ball of radius r centered at the origin in the normed vector space E. 

(8.4) Proposition. For each Go £ V Co , there exists a positive number eo, and an integer 
N such that the following holds: For each pseudograph G £ P satisfying \\G — Go\\ < £o and 
c(G) — Co £ R(co), for each cohomology class c satisfying c — cq £ £? fi ( co )(eo) C R(cq), we have 

G hy c. 

Note in this statement that the cohomology class of the pseudograph G is denoted by c(G), and 
that the symbol c alone denotes another cohomology class. 



(8.5) Proof of Theorem (0.11) We assume the proposition. For Each Go £ V Co , we 
consider the number eo given by the proposition, and the open ball Bf(Go,^o) of center Go and 
radius eo in P. Since V Co is compact, it can be covered by a finite number of these balls, we denote 



Gi and €i the associated centers and radii. Since the function c restricted to V is proper, (3.7) 
there exists a positive number 6 such that V c C L>iBw(Gi, £j) when |c — co| ^ S. Consider two 
cohomology classes c and c in cq + B^ Co ^(e), with e = min{5, e^}. It follows from (6.5) that c 



forces d . The theorem clearly follows. rj theorem □ 



(8.6) Proof of the Proposition. Let us fix a Go £ V Co and choose a neighborhood U 
of T(Go) in such a way that R(Go) is the set of cohomology classes of smooth closed one- forms 
vanishing on U . 

Lemma There exist 5 > and N 1 $J N in N smc/i i/iai 7 /or a/Z overlapping pseudographs G 
satisfying \\Q — Go\\ ^ 5, we have 

Q\u K' ,N (<3) 



Proof. Let us write the pseudograph Go on the form G Co ,u - We have seen in (3.9) that 

u (x) = min u Q (y) + h c „(y,x) = min u (y) + h CQ (y,x). 
yeM y£A(c ) 

As a consequence, we have Tffuo = T^Uq — u , and the minimum in the definition of Tffuo(x) 
is not reached outside of 1(G) , which is a compact set contained in U . The lemma now follows 

□ 



from proposition (6.4) 
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(8.7) Lemma. Let us fix a S > 0. There exists eg > such that, if we take : 

One one hand a cohomology class c satisfying c — Co S R(Go) and \\c — cq\\ ^ eo; 

On the other hand a pseudograph Q G P satisfying \\G — Soil ^ £o and C {G) S c o + R{Go); 

Then there exists a pseudograph Q' G P c ura£/i the following properties: \\G'— Go\\ ^ ^ andQ\u = 

Proof. Let us write Go = Grj ,u - In view of the definition of R(Go), it is possible to associate to 
each cohomology class d G R(Go) & closed one-form fi^ which is null on U. In addition, we can 
impose that the correspondence d i — > fid is linear. Given a pseudograph G G P and a cohomology 
c satisfying the hypotheses of the Lemma, we consider the pseudograph 

G' = G + G Hc _ c(g)) , eP c . 

It is clear that G', v — G\Ui that c(G') = c, and that \\G' — Go\\ ^ S if eo is small enough. rj 



(8.8) We are now in a position to end the proof of the proposition. Let us consider S given by 
Lemma (8.6) and the associated eo as given by Lemma (8.7) If G and c satisfy the hypothe- 



ses of the Proposition with this value of eo, then, by Lemma (8.7) there exists a pseudograph 
G' such that c(G') — c and G! v = G\u an d \\G' — Go\\ ^ 8. In view of Lemma (8.6) we have 

G\U l~JV ®u ' (G'), SO that G \~N $u ' N (G')- □ proposition □ 



9 Arnold's mechanism for systems with finitely many static classes 



We prove and generalize Theorem (0.12) 



(9.1) Let H C (S,S') be the set of orbits of the Mane set J\f(c) which are heteroclinic orbits 
between the static classes S and S' , we denote by 7i c (S,S') its projection on M. We have, from 
section HI 

Af(c)=A(c)U \J H C {S,S'), 

S,S' 

where the union is taken on all pairs (S,S') of different static classes. In addition, it is useful to 
recall that 

H C (S,S') CE C , S AE C , S ,. 

We say that the set Ti c (S, S') is neat if it admits a compact subset K, which contains one and only 
one point in each orbit of ^ s and whose projection K. on M is acyclic. This means that JC 
has a neighborhood U whose inclusion i into M induces the null map z* : Hi(U,M) — > H\{M, R). 

(9.2) Theorem Let Co be a cohomology class such that the number of static classes in -4(co) 
is finite and greater than one. Assume in addition that all the sets TL Co {S,S') are neat. Then the 
class Co is in the interior of its class of Hh- equivalence. 

Let us gather some preliminary consequences of the hypotheses. 

(9.3) Lemma We assume the hypotheses of the theorem. Let S$ be a static class and Vq be a 
neighborhood of Sq . 

(i) There exists an open neighborhood V of Sq, contained in Vo, such that the boundary of V 
does not intersect T(E Co ^s ). 

(ii) There exists an acyclic open set U C Vo — Sq and a static class S\ such that the intersection 
U fl I(E COj s ) is not empty, compact, and contained in Ti.(So,Si). 

Proof. Let Vq be a neighborhood of So, sufficiently small for lemma [(4.4) to apply, so that we 
have 

v Q n i(E CQ , So ) = s u [j (H(S , s) n Vb) , 

SeE(c„)-S 
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where the union is taken on all static classes S ^ So. We shall also assume that Vo H A(co) = So- 
For each static class S, let us consider an acyclic compact set K-(Sq,S) which contains one 
and only one point in every orbit of H.(So,S), and denote by ]C(Sq,S) its projection on the base. 
Clearly, the sets K.(So,S), S G E(co) — <So ; are pairwise disjoint and they all belong to the Lipschitz 
graph T(E Co ^s ), so that their projections IC(So,S) on the base are also pairwise disjoint. Let us 
consider a static class S ^ So- For n large enough, we have it o <fi~ n (JC(So,S)) C Vq. In addition, 
since JC(So,S) is acyclic in M, the compact IC(So,S) is acyclic in T*M. As a consequence, the 
compact set (f)~ n ()C(So, <?)) is acyclic in T*M and contained in the Lipschitz graph I(E C0 s ), so 
that 7r o (f>~ n (fC(So, S)) is acyclic in M. Consequently, recalling that the number of static classes 
is finite, there is no loss of generality in supposing that the sets K,(So,S),S G E(co) — So, are all 
contained in Vo. 

Let us prove that each of the sets ^(^0,5) is isolated in T(E COt s ). Let F be a compact 
neighborhood of So which does not intersect any of the finitely many compact sets IC(So,S),S G 
E(co) — So- Since the points of IC(So,S) are a-asymptotic to So and cj-asymptotic to S, and 
since there are finitely many static classes, there exists an integer N such that all the sets tt o 
4> n (IC(So,S)), n £ N, S G E(cq) — So, are contained in F for n ^ —N, and do not intersect Vo for 
n N. The set (Vq — F) nT(E C0 ^ ) is thus covered by finitely many pairwise disjoint compact sets 
of the form it o (j) n (K,(So,S)),n G Z, 5 G E(c ) — So. As a consequence, each of the sets IC(So,S) 
is isolated in (Vq — F) nl(£ C|)i s ), and then also in T(E Co ^ )- Let us fix a static class Si ^ So 



such that IC(So,Si) is not empty. Such a static class exists by (4.9) Then, we can find an open 
neighborhood U G Vo of IC(So,Si) such that U is acyclic and such that U nl(£ COi s ) = IC(So,Si) 
is a non-empty compact set contained in TC(So,Si). We have proved (ii). 

Let us consider again the finite family of pairwise disjoint compact sets 7r o cj) n (lC(So,S)),n G 
Z, | tt, | ^ N, S G E(co) — <So- There exists a finite family of pairwise disjoint compact sets 
K' n (S ,S),n G N, \n\ ^ N,S G E(c )-S such that IC' n (S , S) is a neighborhood of <Ko<f> n (K,(So, S)). 
We can clearly assume in addition that the sets K,' n (So,S) do not intersect So- The set 

V = Vo- |J lC' n (S ,S) 

neN,|n|<iV,SeK(co)-So 

is an open neighborhood of 5o which is contained in Vo, and its boundary does not intersect 
1{Ec ,So)- We have proved (i). rj 

The following proposition is the main step in the proof of the theorem. 



(9.4) Proposition Let c satisfy the hypotheses of Theorem (9.2) For each weak K AM solu- 
tion Qo G V Co , there exists a number e > and an integer N such that, if Q G IP and c G H 1 (M, R) 
satisfy 

\\G — Go\\ ^ e a^rf c — c < e 

f/ien C/ hjy c. 

(9.5) Proof of the Theorem. We assume the Proposition. Let us cover the compact set 
V Co by a finite number of balls B(Qi, q), where et is given by the Proposition applied to Gi- Since 
the function c restricted to V is proper, the union of these finite balls covers the sets V c for c 

□ THEOREM Q 



sufficiently close to cq. The Theorem holds by Proposition (6.5) 



We now prove the Proposition in three steps. 

(9.6) Step 1. Let Q G V Co be a fixed point. If there exist only finitely many static classes 
in A(co), then there exists an elementary solution Eq and a neighborhood Uq of the corresponding 
static class Sq such that Q\u a — E \u - 
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Proof. Let us fix the solution Q — Gc ,u- We define a partial order on the set of static classes by 
saying that 5^5' if, for each x G S and x' G S', we have h Co (x,x') = u(x') — u(x). It is easy to 
check that this relation satisfies the following three axioms of order relations: 

• 5^5' and 5'^5"^5s: S", 

• S ^ S' and S' ^ S S = S' . 

Since the number of static classes is finite, there exists an initial element 5o, that is an element 
which is not greater than any other element. Let us write 

u(x) = min-ufa) + h Co (a,x), 

and consider, for each point x, the set A(cq) (~1 (Q A E C[)jX ) of points a where the minimum is 
reached. Let us first assume that x £ So. In this case, a is a point of minimum if and only if the 
static class S a of a satisfies S a ^ Sq. Since the class So is initial, this implies that S a — So, or 
equivalently, that a G So- In other words, for x € So, the compact set -4(co) D (G A E C()}X ) does 
not intersect other static classes than So- This implies that, for x sufficiently close to <So, the 
set A(co) (~l (Q A E COtX ) does not intersect other static classes than So- Since, for each x, the set 
•A(co) n (G A E Co , x ) contains a static class, we conclude that, for x sufficiently close to So, we have 

S = A(c )n(G AE C0 , X ). 

As a consequence, we have, if x is sufficiently close to Sq, 

u(x) = u(a) + h Co (a, x), 

for each a G So- In other words, the difference x i — > h Co (a,x) — u(x) is the constant u(a) in a 
neighborhood of So- □ step i n 

(9.7) step 2. Let So be a static class of A(cq) and let Uo be a neighborhood of So satisfying 



(ii) of (9.3) There exists a static class S\, an open neighborhood U\ of S\ and, for each S > 0, a 
number e > and an integer N with the following property : J/£J £ P satisfies \\G — E COt s \\u ^ 6 
and c G H 1 (M, K) satisfies \c — cq\ ^ e, then there exists a pseudograph G' G P c such that 
\\G' - E Ca . Sl \\ Ul ^ 5 and 

G\ Uo 1-jv G[ Ul 

Proof. There exists a static class iSi and an acyclic open set U C Uo — A(cq) such that 

i(E COtSo )nu = i(E CQt s Q )nu 

is a compact set K. C 7i.{S, Si). Let us fix a point xq G So, and denote by uo the function h Co (xq, .). 



(9.8) Lemma. There exists a neighborhood U\ of Si such that the equality 

T ^,u u o(y) = h Co (xo,X!) + h Ca {xi,y) = h Co (x ,x) + h Ca {x,x{) + h CQ (xi,y) 
holds for all x G K,, y G Ui, and x\ G S\. As a consequence, we have 

®u (Eco^o)^ =E COtSl \ Ul , 
and the minimum in the definition ofT^yUoiy) is not reached outside of K when y G U\. 
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Proof. Let us set v — T^ u uq for simplicity. Recall, from (3.9) that all weak KAM solutions 
v G V Co satisfy v(y) — min ae _4( CQ ) v(a) + h co (a, y). Here, we obtain 

v(y)= min h co (x ,x) + h co (x,a) + h cg (a,y). (o) 

x<£U,at£A(c ) 

We claim that, for y £ Si, the set of minimizing pairs (x, a) is JC X Si. Indeed, if (x, a) G JC x Si, 
then a; G E CQ , Xo A £ Co ,a, so that h Co (x 0l x) + h Co (x. a) = h Co (x , a), and 

h Co (x a ,x) + h CQ (x,a) + h CQ (a,y) = h Co (x Q ,y) = min h CQ (x , z) + h CQ (z, z 1 ) + h Co (z',y). 

(z.z')eM xM 

Hence we have 

"c \ x 0i X) + "'c 

(x, a) + h eo (a, y) = min h Co (x 0l z) + h Co (z, z') + h Co (z',y). 

(z,z')eUxA(c) 

We have proved that the pairs of /C x Si are minimizing in the equation (o) for y G Si. 

Let us now prove that they are the only minimizing pairs. A pair (x, a) is minimizing if and 
only if hco(x , a)+h Ca (a, y) = h Co (x ,y) and h Ca (x Q , x)+h CQ (x, a) = h Co (x ,a). The second equality 
implies 

x G E C(uSa A E Ca S ( a) C T(E COtSo ). 

Since I{E COt s ) H U = K., this implies x E JC. If x G JC and a G A(cq), then the equality 
h Co (x, a) — h Ca (x, y) + h Ca (y, a) holds for all y £ Si. Indeed, let x(n) —no <p n (x, —dih(x, a)) be 
the projection of the orbit of the only point of E COi s( a ) above x. We have, for each n G N, the 
equality of calibration by —h Co {., a): 

A Co (0,x,n,x(n)) + na(c ) = h co (x,a) - ft co (a;(n),a). 

Let rife be an increasing sequence of integers such that the subsequence x(nk) has a limit lu G Si. 
Taking the liminf as k — ► oo, we get h Co (x,Lu) h CQ (x, a) — h Co (uj,a), which implies the desired 
equality for cj, and then for all points of <Si. 

Since (x,a) is a minimizing pair for v(y), we get, by decomposing h Co (x,a) in the expression 
of v, 

v(y) = h Cg (x ,x) + h Co (x,y) + h Co (y,a) + h Co (a,y) 

and, since v(y) ^ h co (xo,x) + h Co (x,y), we finally obtain that h Co (y,a) + h CQ (a 1 y) ^ so that 
a E Si. We have proved the claim. In addition, we have proved, for x\ G S\ and x G JC, the 
equality 

v(xi) = h co (x ,x) + h O0 (x,Xi) = h co (x ,Xi). 
As a consequence, for y G Si, each point a G A(c) which is minimizing in the equation 

v(y) = min v(a) + h Co (a, y) 

aeA(co) 

belongs to <Si. Since Si is isolated in A(c), the conclusion holds also for y sufficiently close to Si. 
We then have the equality 

v(y) = v(xi) + h Co (xi,y) = h CQ (x ,x) + h Co (x,xi) + h Ca (xi,y) 

for all xi G <Si and x G JC (and no other x in U). rj 



(9.9) Applying (6.4) we get the existence of a positive e' and of integers N ^ N' such that each 



g G P which satisfies 110 - E, 



c , So \ \U 



< e' also satisfies 



\U ^N' 



N,N' 
U 



(G) 



C/i- 
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Since (E^So) ^ = E Co s 1 ^u 1 in view of the lemma, and by (6.3) the integers N and N' can 
be chosen such that, in addition, we have 



I* 



N,N' 
U 



(E Co ,s ) ~ E C() ^ 1 \\ Ul ^ 6/2. 



Reducing e' if necessary, we can furthermore assume, by continuity of &u' N , that 



I* 



N,N' 
U 



(g)-^- N '(E CruSo )\\ Ul ^S/2 



when \\G - E CQiSo \\ v < e', so that 



Since U is acyclic, for each cohomology c and each pseudograph Q, there exists a pseudograph 
Q(c) which has cohomology c and such that Qm = G{c)\tj. There exists a positive e such that, if 
c — co| ^ e and if \\Q — E COt s \\u ^ e, then we have 

110(c) -E COiSn \\u <e'. 

Note that this norm does not depend on the choice of Q{c). As a consequence, setting Q 1 = 
®u' N (G(c)), we have c(Q') = c, 

Q\u = Q(c)\u \~N' Q\ Ux 

and 

WG'-E^sJu^S. 



□ STEP 2 □ 



(9.10) Step 3. Let S\ be a static class in A(cq) satisfying (i) of (9.3) and let U\ be a fixed 
neighborhood of S\ . There exists a number 8 > and an integer N such that, if Q' G P satisfies 
\\Q' - E COtSl \\ m ^ 6, then Q[ Ut h N c{Q') 

PROOF. There exists an open neighborhood V± C ~U\ of S\ such that X(E Co ^ Sl )nVi — J(E Co , Sl )(W\ . 
(this is (i) of (9.3) ). Let x\ be a point of S\ and set u\ = h Co (xi, .). Recall that (by definition) 

T ^v 1 u i( x ) = mi - n h c {xi,y) + h Co (y,x). 

Taking y = x\ in this expression, we obtain the inequality Vi ui(x) ^ ui(x). On the other hand, 
we have the triangle inequality u\ (x) ^ h Co (x±, y)+h C[) (y, x) for each y, so that T^° Vi Ui(x) =u\(x), 
and 

min h Co (xi, y) + h Co (y,x) = h C(t (xi,x) = min h Co (xi,y) + h Ca (y,x). 



By (3.6) the points y where this last minimum is reached belong to I(E Co ^s 1 ). As a consequence, 
for each x € M, the points where the minimum is reached in the definition of T^ Vi ui(x) belong 
to I(E C0} s 1 ) n Vi, which is a compact set contained in V\. In view of (6.4) there exist integers N 
and N' and a positive real number 5 such that, if Q' € P satisfies \\Q' ~ E C0: Si ||vi ^ 8, then 



The proposition obviously follows from the three steps above. 



□ STEP 3 □ 
n Proposition n 
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Applications 



10 Twist Maps 

The case where M — T is well known and have been studied many times. The resulting time- 
one flow is then a finite composition of right twist maps of the biinfinite annulus T*T. In view of 



(0.10) much of what is known on the existence of orbits with prescribed behavior is summed up 



in the following discussion. 

(10.1) Let G € H 1 (T, M.) be the set of cohomology classes of invariant curves which are Lipschitz 
graphs. The set G is closed, and every point c G G is alone in its class of Hh-equivalence, as follows 



from (5.2) Conversely, if c does not belong to G, then all the sets 2(G), Q 6 V c are properly 



contained in T. It follows that R(G) = K for each Q 6 V c , so that R(c) = M and, in view of (0.11) 
c is in the interior of its class of equivalence. The classes of Hh-equivalence are the points of G 
and the connected components of the complement of G. 

(10.2) For completeness, we recall without proof some of the special properties of Aubry sets 
in dimension one, see |14j for example. The function a is differentiable, and its differential a'(c) 
is the rotation number of every orbit of A/"(c). If a'(c) is irrational, then there is only one element 
in V c . If a'(c) is rational, then the Mather set A4(c) is made of periodic orbits. 

11 Generalized Arnold Example 

(11.1) In this application, we take 

M = T x N, 

where A is a compact manifold of dimension d — 1, and denote by q — (qi, q 2 ) the points of M . 
We assume that the homology group Hi(N,Z) is not trivial. We denote the points of TM by 
(q,v) = (qi,q2,Vi,V2), where (?i,t>i) € TT and (q 2 ,v 2 ) 6 TN. In the same way, we denote by 
(q,p) — (qi , q 2 , Pi , p 2 ) the points of T*M. We will consider the projection m : T x A — ► T and 
the induced mapping 

7Ti : H X (T,R) — > H\T x N,R). 

(11.2) Let us fix a point in N. We will consider Lagrangian systems which satisfy 

L{t,q 1 ,q 2 ,v 1 ,v 2 ) > L(t, q x , 0, v x , 0) 

for all (q 2 ,v 2 ) ^ (0,0), all t G K and all (qi,vi) e TT. Let d v L : TM — ► T*M be the Legen- 
dre transform associated to L. We denote by Ti the submanifold T x {0} of M, by T*Ti the 
submanifold {q 2 = 0,p 2 = 0} of T*M, and TT X the submanifold {q 2 = 0, v 2 = 0} of TM. We 
have 

d v L(TT 1 ) = TTi, 

and this manifold is invariant under the Hamiltonian flow. Moreover, the restriction of the flow 
to T*Ti is the Hamiltonian flow of the restriction Hi(t,qi,pi) := H (t, qi,pi, 0, 0) of H. Setting 
Li(t, qi,vi) = L{t,q\, 0,«i,0), we see that L\ is the Lagrangian associated to H\. We denote by 
4>x the restriction of <fi to T*T. 



(11.3) Theorem Under the non- degeneracy conditions (11. 4) and (11.5) to be specified below, 
the image of ~k\ is contained in one class of Hh- equivalence. 

(11.4) Genericity property for (fix. We assume that every rotational invariant circle of 
cj>i which contains a periodic orbit is completely periodic (every orbit of this circle is periodic). 
We could, more simply, require that the map 4>\ does not have any invariant circle containing 
a periodic orbit. This property is known to be generic in any reasonable sense of the term. 
However, allowing periodic circles includes the important case where tf>\ is integrable, as in the 
original Arnold's example. 
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(11.5) nondegeneracy OF external HOMOCLINICS. We assume that, for each C £ 7r5'(_ff 1 (T,]R 
there exists a finite Galois covering P : Mq — ► M such that the set 

JVloTp{P*(c)) - T*P~ 1 (T*Ti) 

is not empty and contains finitely many orbits. Note that, since H 1 (N,Z) is not zero, it follows 
from (7.2) (4.5) and (11.6) below that there exists a finite Galois covering P : Mo — > M 
such that the set under consideration is not empty. So the important point of our assumption is 
finiteness. As the reader will see it in the proof, this assumption could be somewhat weakened. 

(11.6) Lemma For each cohomology c — 7r*(ci), with c\ £ iJ 1 (T,K), we have Af(c) C T%. As 
a consequence, the restriction to Ti gives a bijection between the set V c and the set V Cl associated 
to the Lagrangian L\ on TY\. 

Proof. Let us fix a cohomology c\ £ i? 1 (T,R) and its image c := 7rJ(ci). Let \i be a form on T 
which represents ci, and rj be its pull back on M = T x N. Consider a pseudograph Q eW c , and 
write it Q — G v ,u- We want to prove that 1(G) C T*T±. Let (q(t),p(t)) be the trajectory of the 
Hamiltonian flow starting in 1(G)- We have, for k < I in Z, 

u(q(l)) - u(q(k)) = J L(a,q(a),q(a)) - ^ qi{a) (qi(a)) + a(c) da 

and 

u(qi(t),0) - u(gi(s),0) < / L(a,(qi(a),0,qi(a),0) - /i gi((T )(gi(a-)) +a(c)dcr. 
It follows that 

l 

L(a, q(a),q(a)) — L(a, (q\(o~), 0), (gi(cr), 0)) da ^ 2(maxw — minu) 

Let us denote by L the function 

L(t, q, v) = L(t, q, v) - L(t, (?i, 0), 0)) 
which is positive except on TT±. Since the integral J^L(a,q(a),q(a))da is finite, we have 

liminf L(o~, q(a) , q(o~)) — 0, 

(j| >OC 

and consequently liminfig-i ,oo(Q2(t), v 2 (t)) = 0. We now return to the inequality 

rl 



L(<J, q(a), q(a))da ^ u(q(t)) - u(q x (t), 0) - u(g(s)) + u(q ± (s), 0), 
from which we get 



L{o-,q(o-),q(o-))do = 0, 

which implies that (q 2 , v 2 ) = 0. We have proved that 1(G) C T*Ti. rj 



(11.7) Let us fix cohomologies c = tt^ci)^! £ iJ 1 (T,K), such that there exists an invariant 
Lipschitz Graph G in V Cl . If the rotation number of <j>\\g is irrational, then V Cl contains only one 



element. As a consequence, V c also contains only one element, so that N(c) 
there is only one static class in A(c). If the rotation number is rational, then in view of (11.4) the 
graph G is a union of periodic orbits, so that Q = M.(c). As a consequence, we have A(c) = T l5 
and there is only one static class. 

In view of (11.5) there exists a finite Galois covering P : M — ► M such that the Lagrangian 
LoTP satisfies the hypotheses of (9.2) As a consequence, the cohomology P*(c) is in the interior 



A(c) = G, and 



of its forcing class for L o TP. It follows from (7.3) that the cohomology c is in the interior of its 
forcing class for L. 
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(11.8) Let c = 7r^(ci) be such that each set 1(G), G G V c is properly contained in Ti. Applying 



(0.11) we observe that R(c) = H 1 (M, R), and c is in the interior of its forcing class. 



(11.9) We have proved that each c G 7r^(T,R) is in the interior of its forcing class. Since the 
subspace nl (ff 1 (T, R)) is obviously connected, it is contained in one forcing class. rj 



Appendix 

A Semi-concave functions 

We recall some useful facts on semi-concave functions. In all this section, M is a compact 
manifold of dimension d. It is useful for the sequel to fix once and for all a finite atlas $ of M 
composed of charts ip : B% — > M, where B r is the open ball of radius r centered at zero in R d . 
We assume that the sets ip(Bi),(p G $ cover M. A family F of C 2 functions is said bounded if 
there exists a constant C > such that 

\\d 2 (uo<p) x \\^C 

for all x G B\, ip G <&, u G F. Note that a bounded family is not required to be bounded in C° 
norm, but will automatically be bounded in C 1 norm and thus equi-Lipschitz. The notion of 
bounded family of functions does not depend on the atlas <E>. 

(A.l) A function u : M — > R is called semi-concave if there exists a bounded subset F u of the 
set C 2 (Af,R) such that 

u = inf f. 

feF u 

A family U of functions is called equi-semi-concave if there exists a bounded set F of functions in 
C 2 (M, R), and, for each function u G U, a subset F u of F such that 

u = inf f . 

Let us first collect some easy consequences of this definition. We shall prove later that the infima 
could be replaced by minima in these definitions. 

(A. 2) An equi-semi-concave set of functions is equi-Lipschitz. 

(A. 3) // U is an equi-semi-concave set of functions on M, and if the infimum inf u6 utt(xo) is 
finite for some xo £ M, then the function v(x) = mf U £yu(x) is finite and semi-concave. 

(A. 4) Let U be an equi-semi-concave set of functions on N x M , where N is another compact 
manifold. Then the functions u(x, .) : M — > R, x G A, u G U form an equi-semi-concave set. 

(A. 5) We say that the linear form p G T X M is a proximal super-differential of the function u 
at point x if there exists a C 2 function / such that / — u has a minimum at x and df x — p. The 
definition would not be changed by requiring that the function / is smooth and that the minimum 
is strict. We say that a linear form p G T X M is a AT-super-differential of the function u at point x 
if for each chart ip G $ and each point y G B2 satisfying <p(y) — x, the inequality 

u o (p(z) —mo ip(y) ^po dip y (z — y) + K\\z — y\\ 2 

holds for each z G B 2 . It is plain that p is a proximal super-differential of u if and only if there 
exists a K > such that p is a AT-super-differential of u. 
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(A. 6) A function u on M is called K- semi- concave if it has a if-super-differential at each point. 
It is equivalent to require that, for each </?£$, the function 

uo V ( y )-K\\ y \\ 2 

is concave on B^. As a consequence, if u is if-semi-concave and if p is a proximal super-differential 
of u at x, then p is a i-T-supcr-diffcrcntial of u at x. 

(A. 7) Let u be a continuous function on M, and let Let A be the compact subset of M formed 
by points x 6 M at which both the functions u and —u have a K- super- differential. Then the 
function u is differ entiable at each point of A, and the mapping x i — ► du(x) is Lipschitz on A, 
with a Lipschitz constant that depends only on K . 

This follows from Proposition 4.5.3 in Fathi's book [T5]. We have the following useful corollary. 

(A. 8) Let U be an equi- semi- concave set of functions. Then there exists a constant K with the 
following property: If u and v are two functions of V, and if A is the set of points minimizing 
the sum u + v, then the functions u and v are differ entiable at each point of A, and the mapping 
A3 x i — > du x = —dv x is K-Lipschitz. 

(A. 9) If u n is a sequence of K -semi-concave functions converging uniformly to a function u, 
then the function u is K- semi- concave. In addition, if x n is a sequence of points of differentiability 
of u n , converging to a point of differentiability x of u, then du n {x n ) — ► du(x). 

Proof. By the Theorem below, the functions u n form an equi-semi-concave, hence equi-Lipschitz 
family of functions. Let x n be a sequence converging to x, and p n be a .fT-super-diffcrcntial of u n 
at x n . The sequence p n is bounded, hence we assume that p n — > p. Let y G Bi and <p 6 $ be 
such that ip(y) = x. For n large enough, the point x n can be written ip(y n ) with y n G i?2- We 
have the inequality 

u n o tp(z) < u n o (p{y n ) +p„ o d(p Vn (z - y n ) + K\\z - y n \\ 2 , 

for each z £ B2, and at the limit, we obtain 

u o tp(z) ^uo tp(y) +po d(p y (z - y) + K\\z - y\\ 2 . 

It means that p is a i^-super-differential of u at x. Under the assumptions of the statement, we 
have p n — du Xn , and p = du x is the only possible limit of this bounded sequence, which is thus 
converging to p. rj 

(A. 10) Theorem A family U of functions is equi-semi-concave if and only if there exists a 
number K > such that all the functions of U are K- semi- concave. In this case, there exists a 
bounded subset F C C 2 (Af, K) and, for each u G U, a subset F u of F which has the following 
properties: 

u = min f 

feF u 

and, for each point x S M and each super-differential p of u at x, there exists a function f G F u 
such that (f(x),df(x)) = (u(x),p). 

In order to prove this result, we need a Lemma: 

Lemma For each K > 0, there exists a bounded subset Lk of T*M which contains all the prox- 
imal super- differentials of all K -semi-concave functions. As a consequence, the K -semi-concave 
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functions are equi-Lipschitz 



PROOF OF the Lemma Let us consider a chart tp £ <£, a if -semi-concave function u, a point 
j/o € Bi, and the point x = tp(y ). Let p be a proximal super-differential of u at x , and let us 
set I = p a o dtp yo . 

CLAIM If \\l\\ ^ UK, then there exists a point y £ B 2 which is a point of differentiability of uotp 
and satisfies 

\\d(uotp) y \\ > (||/||-flif)/3. 

and 

u o tp(y) < inf u o tp. 

Proof of the Claim. Let us prove first that the infimum of u o tp in B 2 is not reached in 
B\. Assume, by contradiction, that there exists a point m £ B\ such that u o <p{m) = infs 2 uo tp. 
Then clearly the function u o tp is differentiable at m, its differential is zero, and the inequality 

u o tp(y ) ^uo tp(m) + K\\y - m\\ 2 

holds. On the other hand, we have 

u o tp(m) < u o tp(z) ^ u o tp(y ) + l(z - y ) + K\\z - y \\ 2 

for all z £ B 2 - Combining these inequalities gives 

l(y - z) ^ K\\z - y Q \\ 2 + K\\ yo - m\\ 2 

for all z £ B 2 . Hence ^ 5K, which is in contradiction with the hypothesis. 

Let us now consider a vector v £ R d of norm 1 and such that l(v) = —\\l\\. We get 

U o tp(y + v)-uo tp(y ) ^ l(v) + K\\v\\ 2 = K - \\l\\. 

Hence the infimum of u o tp on B 2 is not greater than u o tp(y ) + K — \\l\\. It is then possible to 
choose a point y in B 2 such that 

u o tp(y) < min (inf u o tp,u o tp(y ) + 2K — \\l\\). 

In addition, since the function u o tp is differentiable almost everywhere, we can assume that the 
function u o tp is differentiable at y. We have the inequality 

U o (p(yo) ^uo tp(y) + d(u o tp) y (y - y ) + K\\y - y u \\ 2 

from which follow 

d(u o tp) y (y -!/)<no tp(y) - uo tp(y ) + K\\y - y || 2 s$ UK - 
Hence ||d(uo tp) y \\ ^ (||Z|| — HK)/3. This ends the proof of the claim. 

□ CLAIM Q 

In order to continue the proof of the Lemma, we consider the point y £ B 2 given by the claim. 
There exists a chart tp x £ $ and a point y\ £ B\ such that tpi(yi) = tp(y) =: x\. Note that uo tp 1 
is differentiable at xi, and define 

h := d(u o tp 1 ) yi = d(u o tp) y o ditp^ 1 o tp 1 ) yi . 

There exists a constant C > 1, which depends only on the atlas $, and such that 

\\h\\>{\\lo\\-UK)/C. 
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If Iq is large enough, then we have UK, hence we can apply the lemma again, and find a 

chart <£>2) a point yi G B2 and a linear form 1%. In addition, we have 

«°^fc)< inf u, 

p(Bi)Uvi(Bi) 

so that the charts t^i and y>2 are different. Now if ||Z || is sufficiently large, the process can 
be continued further and we can build inductively, for ^ i ^ N, a sequence Xi G Bi of points, 
a sequence tfi G $ of different charts, and a sequence of linear forms such that ||^+i|| ^ 
(\\li\\ — 11K)/C. The process can be continued as long as ^ 1\K. Recall that the cardinal 
of $ is finite, and denote it by |$|. Since all the charts involved in the construction above are 
different, at most |$| steps can be performed. Hence there exists an integer N ^ |$ such that 
\\k\\ ^ 11K for i < N, and \\l N \\ s: UK. This gives a bound to \\l\\, hence to 

Q LEMMA 

We now finish the proof of the Theorem. Let us consider a smooth function g : M. d — > R such 
that ^ g ^ 1, and such that 3 = outside of -B2 and 3=1 inside B\. Since the if-semi-concave 
functions are equi-Lipschitz, and since the manifold M is compact, there exists a number A > 
such that 

max u — min A 

for each if-semi-concave function u. Let us associate, to each chart ip G $, and each point 
(x,p) G T X M satisfying x G <p(B±), the function f x ,p,^ ■ M — > R defined by 

/x, P ,(p : = ff(z)(.P dtp y (z -y) + K\\z - y\\ 2 ) + (1 - g(z))A 

for 2 G i?2, where y = ip~ 1 (x), and f x ,p,ip = A outside of cp(B2). The functions f x . p , v , (x,p) G 
Lk,<P S $ form a bounded subset i 7, of C 2 (M, R). For each if -semi-concave function it, let 
F u cF + lbe the set of functions 

z 1 — ► fx,p,<p{z) + u(x) 

where p is a Tf-super-differential of u at x. We claim that u = min/ G i? u /. In order to prove this 
claim, observe that, for each y £ Bx, ip G $ and j» a if-super-differential of u at a; = y(y), we have 

fx,p,<p ~ u(x) > u 

with equality at x. Indeed, we have the inequalities 

u o tp(z) - u(x) ^po dip x (z - y) + K\\z - y\\ 2 

for z G B 2 and u < u(x) + A. □ theorem □ 

B Uniform families of Hamiltonians 

Let us fix once and for all a Riemann metric on the compact manifold M. We use this metric 
to define a norm \v\ for tangent vectors, and a norm \p\ for tangent covectors. 

(B.l) A family of pairs (H, L) of dual Hamiltonians and Lagrangians satisfying the hypotheses 



(1.1) and (1.2) is called uniform if: 



(i) There exist two superlinear functions ho and hi : R + — ► R such that each Hamiltonian H 
of the family satisfies ^o(|p|) ^ H(t,x,p) ^ hi(\p\). 

(ii) There exists an increasing function K(k) : R + — ► R + such that, if <f> is the flow of a 
Hamiltonian of the family and if the times t and s satisfy t — l^s^t+l, then 

cb s t {{\p\^k}) c{\p\^K(k)}cT*M. 
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(Hi) There exists a finite atlas of M such that, for each chart ^6$ and each Lagrangian L of 
the family, we have ||cP(-k ° Tiji)^^^ || ^ K(k) for \v\ ^ k. 

Note that condition (i) could have equivalently been replaced by the following: 

(i 1 ) There exist two superlinear functions Iq and l\ : R + — > R such that each Lagrangian L of 
the family satisfies ^o(M) ^ L(t,x,v) ^ Zi(|v|). 

(B.2) The uniform families of highest use are the following. If H is a Hamiltonian, and if ui 
is a bounded finite-dimensional convex family of closed one- forms on M , then the Hamiltonians 
H(t, x,p + lj x ) 1 lu £ 51 form a uniform family. Equivalently the Lagrangians L(t, x, v) —uj x (v) form 
a uniform family. 

(B.3) In a uniform family, we have 

H 

and 

| 9 .L( t , I ,,)|> MM)zW . 

\v\ 

In other words, the Legendre transforms are uniformly proper. 
Proof. In view of the convexity of H , we have 

ow . H(t,x,p)-H(t,x,0) 
\Opii{t,x, P ) \ > y ■ 

□ 



(B.4) Given a Lagrangian L satisfying the hypotheses of (1.2) we define the function Al (t, x\ s, y) 

Ix M x R x M — > R by 



A L (t,x;s,y) = inf / L(ct, 7(d), 7(0-)) 



dcr, 



Where £(i, x; s, is the set of absolutely continuous curves 7 : [s, i] — > A/ satisfying 7(i) = x and 
7(s) = y. We denote by a;; s, y) the set of curves of £(£, a;; s, y) which realize the minimum. 

(B.5) For each uniform family of Lagrangians, there exists a decreasing function K\(e) :]0, 00) — : 
R + such that, if L is a Lagrangian of the family and ift and s are two real times satisfying t s+e, 
then each curve 7 £ E^(t,x; s,y) is C 2 and satisfies |7(cr)| ^ K(e) for each a £ [s,i\. 

Proof. Without loss of generality, we can assume that < e < i — s < 1. By comparing the 
action of 7 with that of a geodesic with the same endpoints, we get 



t nt 
Z (|7O)|)d<7 < / L(o-,7(CT),7(<7))d(7< (t-s)h 



/diam(M)\ 
V t-s ) 



The right hand side is clearly bounded by a constant which depends only of the parameters of the 
uniform family and of e. We obtain 

(t-s)mmZ (|7(<7)|) < C, 



from which follows, with another constant C, that min 7(0") | ^ C. But then in view of (B.3)[ we 
have 

min \d v L(a,^(a),j(a))\ ^ C, 

tre[s,t] 
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then in view of (ii), 

max \d v L(a,j(a),j(cr))\ ^ C, 

ae[s,t] 



so that finally, using (B.3) again, we get max I7I ^ C. We have used the symbol C for different 
constants which depend only of e and of the parameters of the family. rj 
Note that the proof does not use (Hi) in the definition of uniform families. 

(B.6) For each times s < t, the mapping which, to a Lagrangian L, associates the function 

(x,y) 1 — ► A L (s,x,t,y) 

of C(M x M, M), is continuous on each uniform family of Lagrangians endowed with the topology 
of uniform convergence on compact sets. 

Proof. Let Lq and L\ be two Lagrangians of the family. Let 7(a) : [s,t] — > M be such that 

A L (s 1 "f(s);t,j(t)) = / L (a,^(a), A /(a))da. 



We have t 

^ii( s ; 7(s);i,7(0) < / Li(a,"/(a),^(a))da, 

J s 

so that 

^Li(s,7(s);*,7(*)) - a l (s, j(s);t,j(t)) < (t - s) max L\ - L 0) 

\v\^Ki(t-s) 



where K\ is defined in (B.5) By symmetry, we get that 



\\A Lo (s,.;t,.)-A Ll (s,.;t,.)\\ 00 ^ : (t-s) max \L X - L \ 

\v\^.K 1 (t — s) 



□ 



(B.7) Theorem. For each uniform family of Lagrangians and each e > 0, consider the set 
U £ of continuous functions M x M — ► R given by 

(x,y) 1 — ► A L (s,x;t,y) 

where t ^ s + e and L is a Lagrangian of the family. This set is equi- semi- concave, hence equi- 
Lipschitz on M x M. Ln addition, for each curve 7 £ S^(t, s, y), t/ie covector 

( - d v L(s, 7 (s), 7(a)), 0„L(i, 7 (t), <y(i))) 

is a proximal super- differential of the function Al(s, .; t, .) at point (x, y). 

Proof. Let us consider a finite atlas $ of M formed by charts ip '■ £>g — > M, where Bf is the 
Euclidean ball of radius r in R d . Assume that the open sets ip(By 2 ), ip G ^, cover M . Let $ be 
the atlas ofMxM composed of products ip x ip 1 , with t/> G ^ and ?// £ The charts </? of $ are 
defined on B\ d , and the images ip(Bf d ), <p G $, cover Af x M. In order to prove that the set U e is 
equi-semi-concave, we shall check that it is if-semi-concave for some K . So from now on we shall 
work in a fixed chart tp — ipo x V"i ■ 

Let (xq,x%) be a point in ipo(B2) x ip\(B2), and let yo and j/i be the preimages in B2. Let 
7(7) : [s,t] — ► M be a curve in T, m (s,Xo]t,Xi). In view of (B.5)| we have |7| ^ K\(e). As a 



consequence, there exists a constant a > 0, which depends only on the atlas, on the parameters of 
the family, and of e, such that the curve ip^oj : [s, s + l/a] — > -B4 is well defined and a-Lipschitz, 
as well as the curve ip^ 1 07: [t — 1/a, t] — ► Bf . Let us call yo(o~) and 2/1(0") these curves, note 
that yo(s) = yo and y\(t) — y\. Let us now define, for each points z§ and z\ in B4, the curves 

yo(cr, z ) := 2/0(0) + (1 + a(s - cr))(z - y ) 
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and 

yi(a,zi) := yi(a) + (1 + a(a - t))(zi - y\). 

For simplicity wc define the Lagrangians L a and L\ on M x Bf x M. d by the expression Li(a, x, v) = 
L(<r,tlj i (x),d'ipi X (v)), shortly, Li = L oT^. We have 

M s ^o(zo);t,ipi(z 1 )) 

r-s+l/a 

^A(s,x ;t,x 1 )+ / L (a,y {(T,zo),yo((T,zo)) - L (a,y ((r),y (a))da 

J s 

+ / L^yifaz^^ifazi)) - Li(a,yi(a),yi(a))da. 

Jt-l/a 

There exists a constant C > 0, which depends only on the atlas, on the parameters of the family, 
of e, and of a, such that, for (t, x, v) G M x Bf x B d and (y, w) e R x Bf x B%, we have 

Li(a,y,w) - L,(a,x,v) ^ d x L i(a . XiV) (y - x) + d v L i(a . XiV) (w - v) + C(\\y - x\\ 2 + \\w - v\\ 2 ). 

We get 

A(s, ip (zo);t, V'i(^i)) ^ A(s,x ;t,x 1 ) 

/s+l/a 
dxLo (a , Vo{a) ,y o{a)) {yo{<7, z Q ) - y {a)) + d v L 0(a ^ yo{a ^ yo{a)) {y {a, z )-y (a))da 

+ [ d x L 0{aiyo{a)iyo{u)) (y (a,z ) - y {cr)) + d v L 0{r7m{a)iVoia)) (y (a, z ) - y (a)) da 

Jt-l/a 

/■s+l/a 

+ C / 1 1 2/0 (o-) - yo{v,z )\\ 2 + \\y (a) - ij a {a , z a )\\ 2 da 

J s 

+C f ||yi(a)-yi(<T,^)|| 2 + ||^i(a)-yi(a,^)|| 2 rf(T. 

Jt-l/a 

Taking advantage of the Euler-Lagrange equations, this simplifies to 

A{s,i) Q {z );t,^ 1 {z 1 )) sC A{s,x Q ;t,xi) - d v L 0{rTiyo , yo{s)) (z - y ) + d v L 1{(T>yuyi{t)) {zi - y x ) 

+ C l -±^(\\y -z \\ 2 + \\ yi - Zl \\ 2 ). 

□ 
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